CraftGPT is a colossus of 439 million blocks that was created by a YouTuber, and it's a fully functional small language model in Minecraft.
As for the actual LLM part of this project, sammyuri trained their CraftGPT in Python with the TinyChat dataset available via HuggingFace. As this comprises fairly basic English-language conversations ...
OmniParser is a comprehensive method for parsing user interface screenshots into structured and easy-to-understand elements, which significantly enhances the ability of GPT-4V to generate actions that ...