6 comments

  • kevmo314 1 day ago
    I like the use of the functional API here. I learned through a similar route and it was very helpful for me compared to trying to understand `torch.nn.Module`.

    Here's a gist of my learning path if it's helpful to anyone: https://gist.github.com/kevmo314/294001659324429bae6749062a9...

    • therealoliver 1 day ago
      Yes, these are two different learning paths. The detailed process learning is beneficial for future research, while the API-style approach is convenient and quick for getting started and using. Both are very useful!
  • simonw 1 day ago
    I hadn't realized OpenAI's tiktoken Python library could work with other models outside of the OpenAI family, that's really useful: https://github.com/therealoliver/Deepdive-llama3-from-scratc...
    • moffkalast 18 hours ago
      It's more than just that, practically every notable open model released in the past year or so uses tiktoken as the tokenizer.
    • therealoliver 1 day ago
      I'm glad to have helped you :)
  • aghilmort 1 day ago
    great need; mulling over; shows up all the time in AI paradigms
  • FreebasingLLMs 1 day ago
    [flagged]
    • jawr 1 day ago
      If you’ve got nothing constructive to say… don’t say anything? OP brings a lot of value in a style they like, your comment brings absolutely nothing.
      • therealoliver 1 day ago
        Thank you for helping me out. Such comments are really depressing.
        • GaggiX 15 hours ago
          Ignore the troll that cries over Anya.
        • FreebasingLLMs 16 hours ago
          Real life feedback: drop the anime shit. It is way out of place. I'm not kidding.
      • FreebasingLLMs 16 hours ago
        I said what I said with purpose. I can't share this shit with anyone serious. It looks like someone who watches too much cartoon porn made this. I'm sorry these types of real life viewpoints offend you. I do sincerely suggest you reflect on what I am saying and consider it with weight.
        • therealoliver 14 hours ago
          Thanks for ur feedback on the project's visual style. Let me clarify a few things: First, associating an anime character, especially a minor, with inappropriate content is unfair and disrespectful to both the character and the original work. Second, this character wasn’t added by me—it was included by the previous developer who created these visualizations. As part of the open-source community, I believe it’s important to respect the project’s history and acknowledge their contributions. Lastly, I appreciate your perspective—it might highlight how cultural differences can shape perceptions, and I’ll pay attention to that in my subsequent work. That said, I also value maintaining the entertainment and avoiding overly dry or preachy content, which I think is equally important. This will likely be my final reply on this matter. Let’s focus on being open-minded and keeping the community peaceful. Thanks again for your support of the technical aspects of the project
  • curtisszmania 1 day ago
    [dead]