🐛 Bug Report: Increase Pagination maximum offset from 5000

[anhmeorv99]

👟 Reproduction steps

Pagination: The maximum offset is 5000. But in some cases, i want use offset > 5000 . I want have default max offset = 5000 and i can config max offset from ENV.

👍 Expected behavior

Pagination: The maximum offset is 5000. But in some cases, i want use offset > 5000 . I want have default max offset = 5000 and i can config max offset from ENV.

👎 Actual Behavior

Pagination: The maximum offset is 5000. But in some cases, i want use offset > 5000 . I want have default max offset = 5000 and i can config max offset from ENV.

🎲 Appwrite version

Version 1.3.x

💻 Operating system

Linux

🧱 Your Environment

No response

👀 Have you spent some time to check if this issue has been raised before?

• I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

• I have read the Code of Conduct

[deepam-kapur]

Raised PR - #5508
On branch - deepam-kapur:fix-5506-pr-for-limit-document-count

Please review it! & lemme know if any change is required!

[joeyouss]

Hi, there is a reason for this.
The maximum offset is 5000, since the request gets slower as the number of records increases because the database has to read up to the offset number of rows to know where it should start selecting data. Also when there is data added in high frequency - the individual pages might skip results.

[byawitz]

In case you have a need to remove this limit in a self-hosted Appwrite, you can do so by overriding init.php file, like so:

1. Edit your docker-compose.yml file, and bind the file to any container that uses the appwrite/appwrite image.

   appwrite:
    image: appwrite/appwrite:1.3.7
    container_name: appwrite
    <<: *x-logging
    restart: unless-stopped
    networks:
      - appwrite
    labels:
      ...
    volumes:
      ...
      - /root/customized/init.php:/usr/src/code/src/app/init.php
    depends_on:
      ...
    environment:
      ...

2. Create a file in the location /root/customized and name it init.php. inside that file paste all the content of the original init.php file
3. Edit this line. set it to whatever value you like.

const APP_LIMIT_COUNT = 5000000;

Then you're set to go.

[byawitz]

Also, this ☝️PR can give any self-hoster of Appwrite the option to change this option in the .env file.

[tripolskypetr]

That will be quite usefull for my project. I need to fetch all documents in appwrite function once a day but that limit force me to make multiple requests for that