Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GSoC'25: Manas Hejmadi (AI UI Designer) #755

Merged
merged 6 commits into from
Apr 5, 2025
Merged

Conversation

synapsecode
Copy link
Contributor

PR Description

Submitting the initial version of my GSoC 2025 Proposal for the "AI UI Designer for APIs" idea. This PR includes an md file that contains details about the deliverables, system architecture and flow along with other implementation details. It also includes a weekly timeline according to apidash's prescribed format.

Looking forward to contribute to API Dash!

Related Issues

Checklist

  • I have gone through the contributing guide
  • I have updated my branch and synced it with project main branch before making this PR
  • I am using the latest Flutter stable branch (run flutter upgrade and verify)
  • I have run the tests (flutter test) and all tests are passing

Added/updated tests?

We encourage you to add relevant test cases.

  • Yes
  • No, and this is why: This PR was just to submit my GSoC application

OS on which you have developed and tested the feature?

  • Windows
  • macOS
  • Linux

@synapsecode synapsecode changed the title GSoC'25 Application: Manas Hejmadi GSoC'25: Manas Hejmadi (AI UI Designer) Apr 1, 2025
@animator
Copy link
Member

animator commented Apr 2, 2025

@synapsecode Can you go ahead and submit a PoC.

@synapsecode
Copy link
Contributor Author

Hello. Yes I am working on it. Will share it by tomorrow.
thanks for your time

@synapsecode
Copy link
Contributor Author

Hi @animator @ashitaprasad

here's my separate PoC created for this proposal. It demonstrates the entire flow in a simplified manner.
i have kept this separate from apidash's codebase to speed up development and iteration.
once i get a green signal from mentors I will start moving it to the apidash codebase and demonstrate it there

Repo Link: https://github.com/synapsecode/AI_UI_designer_prototype

Features Implemented:

  • API Response Semantic Analysis (SA) & Intermediate Representation(IR) Generation
  • SA + IR into Flutter Component
  • Component Modification using Natural Language
  • Component Live Preview (using my own previewer: FlutRun)
  • Support for Local Ollama (llama3) and CustomLLMs: Gemini(2.0-flash), AzureOpenAI in a very modular way
  • Multiple Bots created using the APIDashAIAgent abstract class mentioned in my proposal, This makes it very easy to create future AI capable actions (for example in Dashbot)
  • Generated Code Copy to Clipboard

PoC Demo Video

NOTE: for video length reasons, parts of the loading have been trimmed.
NOTE: The actual flow will not contain the middle page (semantic analysis). this is kept here so that the flow is clear to the mentors

AI_UI_DES_PROTO_DEMO.mp4

Hope you find this satisfactory, thanks!

@synapsecode
Copy link
Contributor Author

synapsecode commented Apr 4, 2025

@animator @ashitaprasad

Have implemented the changes that you had asked for

  • Converted the WebView Code Preview into a SDUI Based Preview System
  • Added AI-Powered Tool Generation also to the proposal
  • Extended the Timeline to 12 Weeks
  • Modified the overall proposal to look and feel more cohesive
  • Updated the PoC to reflect the SDUI Change

Please review it when you find the time!
Thanks.

@synapsecode
Copy link
Contributor Author

@animator

The requested changes have been completed:

  • Remove Buffer Details
  • Convert all the url images into locally stored images
  • Merge Week 10 & 11 into 10 & shift the other week details & Remove Week 13

@animator
Copy link
Member

animator commented Apr 5, 2025

@synapsecode Thanks. You can go ahead and submit the updated proposal 🚀

@animator animator merged commit 0060447 into foss42:main Apr 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants