User Interfaces
The interfaces are designed using ShinyJS and pure Shiny components and located within the shiny_app/ui.R. The defaults values shown in the UI components are loaded using the helpers/config.R. As described in the UI is structured such that There are 3 main pages in the layout
- The Experiment page which contains the experimental setup and running interface. More information can be found in the User guide under Experiment run page.
- The Pipeline setup page which contains the pipeline setup stages. where each stage is sub divided into generation, update and view and test stage (except for SPARQL query step) More information can be found in the User guide under Setup Pipeline Page.
- The Overview page which contains the details about the application.
The pipeline contained 4 steps as detailed in the Home page each UI tab developed for a step contains a subtabs for generation, update and view and test stage. In the generation step we utilize the input elements to get the required data to generate step output. status is displayed at the top of the component where either success or error messages are displayed. The update and view tab shows the output of the generation step where the user and edit the generated output. The testing tab can be used to test the generated output given the required input. Further below the pipeline steps tabs we utilize another component to display the utilization of the already completed steps generation in the pipeline using a sample data.
The page has two main ways to run a experiment when we select the Answer Generation form. we utilize the user given system prompt Template , user prompt and the number of runs , and the set of LLMs to generate an LLM answer, we can further give the the data as a CSV file to run it for a whole batch. when we select Fact Extraction we can upload the a Pipeline configuration file and data file using file upload components to run the pipeline on the answers.
