apolloduck.com
robots.txt

Robots Exclusion Standard data for apolloduck.com

Resource Scan

Scan Details

Site Domain apolloduck.com
Base Domain apolloduck.com
Scan Status Ok
Last Scan2024-10-08T14:20:54+00:00
Next Scan 2024-10-15T14:20:54+00:00

Last Scan

Scanned2024-10-08T14:20:54+00:00
URL https://apolloduck.com/robots.txt
Redirect https://www.apolloduck.com/robots.txt
Redirect Domain www.apolloduck.com
Redirect Base apolloduck.com
Domain IPs 149.11.45.155
Redirect IPs 149.11.45.155
Response IP 149.11.45.155
Found Yes
Hash d7792fec9b39ef60159cbc8ef4e2dc94884ae08bdb40145e1da41857b0b0be98
SimHash 2105f460ac81

Groups

mediapartners-google

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /graphics/
Disallow /logos/
Disallow /video_bin/
Disallow /legal/
Disallow /service/
Disallow /members/
Disallow /submissions/
Disallow /welcome/
Disallow /enquire.phtml
Disallow /new/contact.phtml
Disallow /js/

ia_archiver

Rule Path
Disallow /

lcc

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /