Confluent AI: LLM-Driven Procedural Terrain Generator
This project demonstrates a comprehensive Procedural Terrain Generator built using C++ and OpenGL. It leverages advanced rendering techniques to create a realistic and immersive environment. The project integrates LLM (Large Language Model) input to allow users to modify terrain parameters dynamically using natural language.
Key Contributions
- Developed and integrated a custom procedural terrain generation system using Perlin noise and advanced shader techniques, incorporating GPT-4 for dynamic terrain modifications based on high-level, natural language prompts, enhancing accessibility for non-technical users.
- Enabled AI-driven terrain customization, showcasing advanced prompt engineering and LLM integration in interactive graphics
- Leveraged GPT-4 function-calling to extract structured data for real-time modification of terrain parameters (e.g., ruggedness, frequency).
- Designed a robust system to parse complex, high-level commands from natural language into precise graphical parameter adjustments, utilizing embeddings and similarity search to interpret varied terrain modification requests.
- Deployed infrastructure to locally run and fine-tune open-source LLMs for low-latency, high-efficiency interaction, optimizing prompt engineering to achieve accurate terrain representations based on vague or abstract prompts. [In Progress]
Tech Stack
- Programming Language: C++, GLSL
- API: OpenGL, OpenAI, Llama
- Libraries: GLFW, GLAD, glm, ImGui, libcurl, nlohmann/json
- Tools: CMake for build management
[This project is part of a product being developed for my startup. Code for the project is available upon request, subject to review based on the nature of the request.]