Short Introduction in DESY-IT's DESY-Assistant

First of all: there are no agreed DESY policies yet. As far as we know there are ongoing activities between the data protection office (D4), the workers’ council (BR) and the administrative department. Please keep this in mind, esp. when handling data privacy relevant
data and adhere to the GDPR anyhow.

The DESY-Assistant is solely a test environment for first activities with dedicated hardware. It is provided as a “best effort” service, esp. there is no redundancy (yet) for the hardware and support also is “best effort”.  Also not all services mentioned below are using fast (but not many) GPU hardware, some are still using CPUs, so please be patient. Also be aware, that changes may occur anytime.

DESY-IT’s AI-based DESY-Assistant resides on-premise. This means, no data is transferred outside DESY. If you upload any data in course of its usage, e.g. some text to summarise, this data is only related to you and not shared with anyone else.

Services offered
 

Chat – like ChatGPT

• The “DESY” mode: even if named “DESY” there is no DESY-specific data having been trained into the system; so asking questions about DESY’s directors will most probably not answered correctly
• The “Maxwell” mode: in this mode the LLM has been enriched with Maxwell cluster specific information
• The latter one uses Retrieval Augmented Generation (RAG) to enhance the answers
• You may upload your own data, which then will be used as RAG source
• LLMs: Mixtral-8x22B-Instruct
   

Vison – image to text

• Description of images
• Pixtral-12B-2409
   

Speech to Text

• Transcription
• Whisper-based

   

Text to Image

• FLUX.1