newboats.apolloduck.com
robots.txt

Robots Exclusion Standard data for newboats.apolloduck.com

Resource Scan

Scan Details

Site Domain newboats.apolloduck.com
Base Domain apolloduck.com
Scan Status Ok
Last Scan2024-09-22T19:53:25+00:00
Next Scan 2024-10-22T19:53:25+00:00

Last Scan

Scanned2024-09-22T19:53:25+00:00
URL https://newboats.apolloduck.com/robots.txt
Domain IPs 149.11.45.155
Response IP 149.11.45.155
Found Yes
Hash 8b8e1642a9265bd3d06c6de1d36c5044ad74dfc7546c0423ef0bc5ce48713517
SimHash 2305f460ac81

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /graphics/
Disallow /logos/
Disallow /video_bin/
Disallow /legal/
Disallow /service/
Disallow /members/
Disallow /submissions/
Disallow /welcome/
Disallow /enquire.phtml
Disallow /new/contact.phtml
Disallow /js/

ia_archiver

Rule Path
Disallow /

lcc

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /