Update the prompt limit based on the llm model being used

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Done
    • Priority: Major - P3
    • No version
    • Affects Version/s: None
    • Component/s: GAI
    • None
    • Not Needed
    • Developer Tools

      Currently we are limit prompt to 512k characters (~128k token). This was the limit in gpt4o. Chatbot uses 4.1 where token limit is 1M (and we should be able to use 4M character limit).

            Assignee:
            Basit Chonka
            Reporter:
            Basit Chonka
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: