10. Xorbits

This chapter introduces the distributed data science tool Xorbits and the large model inference tool Xinference.

• 10.1. Xorbits Data
  • Xorbits Cluster
  • API Compatibility
  • Deferred Execution
• 10.2. Xinference
  • Inference Engine
  • Cluster
  • Using Models
  • Example: Using Llama for Simple Conversation
    • Chat Completion API
  • Example: Document Chatbot Based on LangChain
    • Start the Vector Model
    • Start the Vector Database
    • Start the Large Language Model