quickdl.app
robots.txt

Robots Exclusion Standard data for quickdl.app

Resource Scan

Scan Details

Site Domain quickdl.app
Base Domain quickdl.app
Scan Status Ok
Last Scan2025-06-16T00:09:09+00:00
Next Scan 2025-06-23T00:09:09+00:00

Last Scan

Scanned2025-06-16T00:09:09+00:00
URL https://quickdl.app/robots.txt
Domain IPs 104.21.1.35, 172.67.186.128, 2606:4700:3031::6815:123, 2606:4700:3036::ac43:ba80
Response IP 172.67.186.128
Found Yes
Hash 2390888f4e5733ea59ce68975bc84e827800821458185a124ceb17dd35d17afd
SimHash 7334dc428289

Groups

*

Rule Path
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /trackback/
Disallow /offers/*
Disallow /go-store/*
Disallow /feed/
Disallow /go/*
Disallow /get/page/*
Disallow /bonus-category/online-casinos/page/*
Disallow /play-now/*
Disallow /registration/*
Disallow /bwin.php*
Disallow /playnow.php*
Disallow /goo/*
Disallow /r/*
Disallow /f/*
Disallow /fly/*
Disallow /content/go/*
Disallow /wp-content/cache/*

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://quickdl.app/sitemap.xml