Awesome Generative AI Data Scientist

The Future is using AI and ML Together

🚀🚀 100+ Free Resources On Generative AI for Data Scientists

A curated list of 100+ resources to help you become a Generative AI Data Scientist. This repository includes resources on building GenAI Data Science applications with Large Language Models (LLMs) and deploying LLMs and Generative AI/ML with Cloud-based solutions.

Please ⭐ us on GitHub (it takes 2 seconds and means a lot).

Contributing

Contributions are welcome! Please submit a pull request or open an issue if you have suggestions for new resources or improvements to existing ones. Thanks for your support!

Table of Contents

• Awesome Generative AI Data Scientist
  • 🚀🚀 100+ Free Resources On Generative AI for Data Scientists
  • Contributing
  • Table of Contents
• Awesome Real-World AI Use Cases
• Python Libraries
  • Curated Python AI, Data Science, and ML Compilations
  • Data Science And AI Agents
  • Coding Agents
  • Deep Research Agents
  • AI Frameworks (Build Your Own)
  • AI Frameworks (Drag and Drop)
  • LLM Providers
  • Open Source LLM Models
  • LangChain Ecosystem
  • LangGraph Extensions
  • Huggingface Ecosystem
  • Vector Databases (RAG)
  • Pretraining
  • Fine-tuning
  • Testing and Monitoring (Observability)
  • Document Parsing
  • Web Parsing (HTML) and Web Crawling
  • Agents and Tools (Build Your Own)
  • Agents and Tools (Prebuilt)
  • LLM Memory
  • LLMOps
  • Code Sandbox (Security)
  • Browser Control Agents
  • Prompt Improvement
• R Libraries
  • Curated AI, ML, Data Science Lists
  • Ellmer-Verse
  • mlverse
  • Other Popular Interfaces to LLM Models in R
  • RAG in R
• LLM Deployment (Cloud Services)
• Examples and Cookbooks
  • Building AI
  • Deploying AI
  • Amazon Web Services (AWS)
  • Microsoft Azure
  • Google Cloud Platform (GCP)
  • NVIDIA
• Newsletters
• Courses and Training
  • Free Training
  • Paid Courses

Awesome Real-World AI Use Cases

Project	Description	Links
🚀🚀 AI-Powered Data Science Team In Python	An AI-powered data science team of copilots that uses agents to help you perform common data science tasks 10X faster.	Apps | Examples | GitHub
🚀 Awesome LLM Apps	LLM RAG AI Apps with Step-By-Step Tutorials.	GitHub
AI Hedge Fund	Proof of concept for an AI-powered hedge fund.	GitHub
AI Financial Agent	A financial agent for investment research.	GitHub
Structured Report Generation (LangGraph)	How to build an agent that can orchestrate the end-to-end process of report planning, web research, and writing. Produces reports of varying and easily configurable formats.	Video | Blog | Code
Uber QueryGPT	Uber's QueryGPT uses large language models (LLM), vector databases, and similarity search to generate complex queries from English (Natural Language) questions, enhancing productivity for engineers, operations managers, and data scientists.

Python Libraries

Curated Python AI, Data Science, and ML Compilations

Project	Description	Links
Awesome Generative AI Data Scientist	A curated list of 100+ resources for building and deploying generative AI specifically focusing on helping you become a Generative AI Data Scientist	GitHub
LLM Engineer Toolkit	A curated list of 120+ LLM libraries organized by category.	GitHub
🚀🚀 Best of ML Python	A ranked list of awesome machine learning Python libraries. Updated weekly.	GitHub
🚀🚀 Awesome Python Data Science	Probably the best curated list of data science software in Python.	GitHub
Awesome Production Machine Learning	A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning	GitHub
Awesome AI Agents	A list of AI autonomous agents	GitHub

Data Science And AI Agents

Project	Description	Links
🚀🚀 AI Data Science Team In Python	AI Agents to help you perform common data science tasks 10X faster.	Apps | Examples | GitHub
🚀 PandasAI	Open Source AI Agents for Data Analysis.	Documentation | GitHub
Microsoft Data Formulator	Transform data and create rich visualizations iteratively with AI 🪄.	Paper | GitHub
Jupyter Agent	Let a LLM agent write and execute code inside a notebook.	Hugging Face
Jupyter AI	A generative AI extension for JupyterLab.	Documentation | GitHub
WrenAI	Open-source GenBI AI Agent. Text2SQL made Easy!	Documentation | GitHub

Coding Agents

Project	Description	Links
Qwen-Agent	A framework for developing LLM applications based on the instruction following, tool usage, planning, and memory capabilities of Qwen. It also comes with example applications such as Browser Assistant, Code Interpreter, and Custom Assistant.	Documentation | Examples | GitHub

Deep Research Agents

Project	Description	Links
HuggingFace OpenDeepResearch	Open version of OpenAI's Deep Research agent.	Blog | Example | GitHub
OpenDeepResearcher	AI researcher that continuously searches for information based on a user query until the system is confident that it has gathered all the necessary details.	GitHub

AI Frameworks (Build Your Own)

Project	Description	Links
LangChain	A fr