Skip to main content

Testing scenarios

This document goes over various testing scenarios involved in making the ai3-hackathon GitHub repository on MSI laptop.

  1. Hardware check
    • Compare MSI server specs with MSI laptop.
    • MSI laptop: 4070 with 8GB memory (4GB physical + 4GB virtual) and Intel-i7 13th Gen
    • MSI server: 4070 with 16 GB memory and Intel-i9 13th Gen
  2. Required files
    • input_data.zip extracts to /data folder which has lookup DB and model files to load the model for inference.
    • PSIAP_AI3.zip extracts to /PSIAP_AI3 folder which has files for the publisher, required to test local pub/sub.
  3. Model loading:
    1. Faced issues loading the model due to Hugging face credentials issue which made it look online for the models even though local files are present.
    2. Fixed it by saving Hugging Face credentials in environment variables, as follows:
      1. Open a terminal window.
      2. Run the command: python
      3. Run the command: import huggingface_hub as hf
      4. Run the command: hf.login()
      5. Paste the key in when prompted.
    3. The model takes about 5-8 seconds on MSI server to load the shards.
    4. Once the shards are downloaded from the internet, it takes about 8-15 seconds to load on MSI laptop in offline mode.
  4. Model Inference speed
    • On MSI server, the model takes about 2-5 seconds for inference.
    • On MSI laptop, the model takes about 2-10 seconds for inference.
  5. Internet access
    • Need to verify the app functionality with and without internet access.
    • The model loading and inference speeds in these cases are documented in the above sections.