First prediction call - loading model... Loading model for the first time... ✓ Found local model at: /src/data/models/DeepSeek-OCR ✓ Using local model: /src/data/models/DeepSeek-OCR Loading tokenizer from /src/data/models/DeepSeek-OCR... ✓ Tokenizer loaded successfully Loading model from /src/data/models/DeepSeek-OCR... Loading model with float32 (CUDA compatible)... You are using a model of type deepseek_vl_v2 to instantiate a model of type DeepseekOCR. This is not supported for all configurations of models and can yield errors. Some weights of DeepseekOCRForCausalLM were not initialized from the model checkpoint at /src/data/models/DeepSeek-OCR and are newly initialized: ['model.vision_model.embeddings.position_ids'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. ✓ Model loaded with float32 Checking CUDA availability... ✓ Model loaded to GPU ✓ Model cached and ready for inference Using task type: markdown with prompt: <|grounding|>Convert the document to markdown. ✓ Created output directory: results/20251101_040320_bf0b2b13 DEBUG: Current working directory: /src DEBUG: Relative output directory: results/20251101_040320_bf0b2b13 DEBUG: Absolute output directory: /src/results/20251101_040320_bf0b2b13 Saving inference results to: results/20251101_040320_bf0b2b13 Processing image: https://khang119966-deepseek-ocr-demo.hf.space/gradio_api/file=/tmp/gradio/d1d01f161fba31282f2e95057dc3f8d177257ed4932c9e01676dea1d8e3e3a59/doc_markdown.png Using device: cuda Using mode: gundam (base_size=1024, image_size=640, crop_mode=True) Downloading image from URL: https://khang119966-deepseek-ocr-demo.hf.space/gradio_api/file=/tmp/gradio/d1d01f161fba31282f2e95057dc3f8d177257ed4932c9e01676dea1d8e3e3a59/doc_markdown.png ✓ Image downloaded to: /tmp/deepseek_ocr___2jra5p/doc_markdown.png /root/.pyenv/versions/3.12.11/lib/python3.12/site-packages/transformers/generation/configuration_utils.py:590: UserWarning: `do_sample` is set to `False`. However, `temperature` is set to `0.0` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `temperature`. warnings.warn( The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results. Setting `pad_token_id` to `eos_token_id`:None for open-end generation. The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results. The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead. `get_max_cache()` is deprecated for all Cache classes. Use `get_max_cache_shape()` instead. Calling `get_max_cache()` will raise error from v4.48 ===================== BASE: torch.Size([1, 256, 1280]) PATCHES: torch.Size([6, 100, 1280]) ===================== The attention layers in this model are transitioning from computing the RoPE embeddings internally through `position_ids` (2D tensor with the indexes of the tokens), to using externally computed `position_embeddings` (Tuple of tensors, containing cos and sin). In v4.46 `position_ids` will be removed and `position_embeddings` will be mandatory. <|ref|>sub_title<|/ref|><|det|>[[130, 72, 624, 97]]<|/det|> ## Aspire OCR and Barcode Recognition <|ref|>text<|/ref|><|det|>[[130, 107, 855, 144]]<|/det|> High performance, royalty- free OCR and barcode recognition on Windows, Linux, Mac OS and Unix. <|ref|>text<|/ref|><|det|>[[130, 153, 855, 245]]<|/det|> Aspire OCR (optical character recognition) and barcode recognition SDK offers a high performance library for you to equip your Java applications (Java applets, web applications, Swing/JavaFX components, JEE enterprise applications), C#/VB.NET applications, and C/C++/Python applications with functionality of extracting text and barcode information from scanned documents. <|ref|>sub_title<|/ref|><|det|>[[130, 260, 484, 281]]<|/det|> ## Convert Images To Searchable PDF <|ref|>text<|/ref|><|det|>[[130, 290, 867, 327]]<|/det|> With a few lines of code, you can convert various formats of images such as JPEG, PNG, and TIFF into searchable PDF. <|ref|>table<|/ref|><|det|>[[130, 335, 869, 392]]<|/det|>

PDF Output Formats	Remarks
PDF	Normal PDF
PDF/A	ISO 19005

<|ref|>sub_title<|/ref|><|det|>[[131, 405, 422, 425]]<|/det|> ## All Popular Barcode Formats <|ref|>text<|/ref|><|det|>[[130, 434, 830, 472]]<|/det|> All popular barcode formats are supported: EAN- 8, EAN- 13, UPC- A, UPC- E, ISBN- 10, ISBN- 13, Interleaved 2 of 5, Code 39, Code 128, PDF417, and QR Code. <|ref|>image<|/ref|><|det|>[[131, 508, 400, 560]]<|/det|> <|ref|>image<|/ref|><|det|>[[576, 512, 768, 655]]<|/det|> ===============save results:=============== image: 0%| | 0/2 [00:00