I have a list of more than 16,000 thousand up to date active onion domains and I'm trying to download each page with parallel requests through python with tor client as the proxy. All requests take not more than 45 minutes. But I can only download around 4000 domains. But when I try to do the same thing with one request per 5 minutes I can download all domains.
Appreciate it if someone can explain the reason for this.