The next ScaDS.AI Meetup on March 11th will again be a hands-on edition, this time focusing on the topic of local Large Language Models (LLMs). We will answer and discuss questions such as: What does it take to run LLMs locally? How do open source models compare to the proprietary base models of the major AI vendors? What are the benefits and challenges of running your own LLM?

In addition to exploring the latest developments and discussing real-world use cases, this meeting will give you the opportunity to run your own local LLMs in an interactive workshop. The workshop is open to anyone interested. You can bring your own laptop to experiment with local LLMs. We will provide you with prepared hardware, including a dedicated GPU machine. This will allow you to explore larger models on site.

1. AI insights: Exploring local LLMs

With a focus on local LLMS, we address the following points:

• • What open-source models are available, and where can you find the right one for your use case?

• • How do you keep up-to-date with the latest developments in open-source LLMs?

• • What hardware and software do you need to run a model locally?

• • What are the advantages of local LLMs in terms of data privacy and customization compared to cloud-based solutions? Are there disadvantages?

We will show a live demo to illustrate how to get an LLM up and running with Ollama, along with helpful tools like open-webui for a productive and private local setup.

2. Guest Talk: AI-Driven Pipeline for Generating Draft Medical Reports in Myocardial Scintigraphy

Dr. Peter Werner will present his project on using local LLMs for the automated creation of draft medical reports in myocardial scintigraphy. Data privacy concerns often limit the use of cloud-based LLMs in sensitive fields like healthcare. Local LLMs offer a promising solution by ensuring that data remains secure and private. This session will highlight a real-world application, demonstrating how local LLMs are being experimentally used to streamline repetitive tasks, such as medical documentation.

3. Interactive Workshop: Local LLMs, but how?

Join us for a hands-on workshop where we will guide you step-by-step in setting up and experimenting with local LLMs.

What you can expect:

• • No prior knowledge is required! Feel free to bring your laptop for your own local setup.

• • Programming experience is helpful, but not essential. We’ll help you get started and introduce you to the basics.

• • Hands-on learning: work in a collaborative and enriching environment based on the Meetup community and ScaDS.AI staff

Workshop Structure:

• • Introduction & preparation (5:45pm – 6:00pm): We install Ollama and start a local model. After everything is set up, including open-webui, we can start playing around.

• • Hands-On Practice (6:00pm – 6:30pm): Test it out for yourself! Try out different models, experiment with your own prompts and explore how the models run on a more powerful GPU setup. Get a feel for what it takes to run these models and how powerful they are compared to those from the major vendors.We are happy to provide a step-by-step guide to follow along.

4. OpenLab and Networking

After the presentations and the workshop, we invite you to our Living Lab, where you can get to know our lab and discuss with other participants, AI researchers and developers.
Take this opportunity to exchange ideas, network with like-minded people and explore potential collaborations.
In addition, we encourage participants who have already experimented with local LLMs to share their experiences with the community!

On Feb. 18, we are introducing an interactive format of the Meetup where you can dive into the latest AI innovations and actively participate in an AI pair programming workshop. Like the Meetup itself, the format is aimed at AI enthusiasts and experienced developers as well as curious beginners and interested parties.

1 – AI Insights
In this part, we will explore what’s currently shaping the AI community, from groundbreaking reasoning models to chain-of-thought (COT) approaches. You will learn about the most exciting innovations, trends and use cases and how these models can lead to impactful applications.
We will also present a live demo to bring these concepts to life, illustrating how reasoning and COT models like O1 or R1 work in practice. Whether you’re interested in theory, implementation, or finding practical resources like GitHub repositories or Huggingface Modelcards or even spaces, this session provides a comprehensive overview of the latest in AI.

2 – Interactive Workshop: AI Pair Programming
Roll up your sleeves and join us for a hands-on workshop designed for participants of all skill levels. Whether you are a complete beginner or an experienced programmer, this workshop will inspire and challenge you!
What to expect:

• We provide laptops and examples, you just bring your curiosity and motivation.
• No programming experience required. We will guide you through the process and help you get started.
• Collaborative learning: We will pair participants in groups to foster knowledge sharing, matching experienced programmers with beginners to create an enriching learning environment.

Workshop Structure:

• Introduction: Learn what AI-pair-programming is all about and see a showcase with a demo case.
• Guided Example: Follow step-by-step instructions to understand how to program with AI, complete with frameworks, extensions, and tools.
• Hands-On Practice: Experiment with your own ideas or prepared examples. Whether you are trying out AI pair programming for the first time or want to deepen your knowledge, this is your opportunity to immerse yourself in the subject matter.

3 – Outlook & Feedback

We willl close the formal part of the Meetup by sharing details about the next event, including the topic and date, and gathering feedback from you. Let us know what you loved about this Meetup and what you’d like to see in the future!

4 – OpenLab and Networking

After the workshop, we invite you to our Living Lab for live AI demos and the opportunity to connect with like-minded individuals, AI experts, and potential collaborators. Enjoy a relaxed atmosphere to share ideas, discuss challenges, and expand your network.

Immerse yourself on 25.11.2024 in the fascinating world of Artificial Intelligence (AI) and discover how projects can be successfully realized from conception to practical implementation. At the upcoming ScaDS.AI Meetup, you will gain valuable insights into the outstanding regional and local research landscape that makes Leipzig, Dresden, Saxony and Central Germany a central hub for AI development. Learn how to collaborate with our center, the AI Factory, and partners like InfAI, and explore the diverse opportunities for developing and integrating AI solutions. Do you have specific ideas or visions? Discuss them with us!

Join us for exciting presentations, an inspiring AI success story from a regional company, and plenty of networking opportunities during our OpenLab session. Gain insights into current research topics, test demonstrators and be inspired by innovative impulses in the field of Artificial Intelligence.

1. Presentation by KI-Manufaktur
   KI-Manufaktur introduces itself as a partner for small and medium-sized companies and commissioned work.
2. Company presentation: TIQ Solutions
   Paper documents, manual effort and errors are still part of everyday working life, while the integration of different systems and interfaces is a complex matter. These obstacles not only make data collection and processing more difficult, but also affect the quality and speed of decision-making. In this presentation, you will learn how you can use artificial intelligence (AI) to optimize your paper-based processes and structure data efficiently. Using illustrative use cases and examples of intelligent document processing, we will explain the challenges and procedures for leveraging the added value of the technologies shown for companies.
   
3. AI Insights
   In this section, we show what is currently moving the AI community, what innovations and trends there are and how the latest models can be used for exciting use cases. In a small accompanying live demo, we also present one or two showcases in practice. What possibilities arise from this, what current models are available and what can you do with them? Which GitHub repositories implement exciting projects and how do you get it all up and running (yourself)? We would like to give you an insight into our daily work, but also venture a brief overview.
4. Review of the year and outlook
   We look back on the year, the past Meetups and would like to venture a look ahead to the new year 2025. We also welcome feedback on the format!
5. OpenLab and networking
   After the presentations, we invite you to join our Living Lab. Experience our AI demos live and interact with other attendees, AI experts and network contacts in a relaxed atmosphere.