clearnightsky.com
robots.txt

Robots Exclusion Standard data for clearnightsky.com

Resource Scan

Scan Details

Site Domain clearnightsky.com
Base Domain clearnightsky.com
Scan Status Ok
Last Scan2025-10-15T13:30:07+00:00
Next Scan 2025-10-22T13:30:07+00:00

Last Scan

Scanned2025-10-15T13:30:07+00:00
URL https://clearnightsky.com/robots.txt
Domain IPs 139.180.191.154
Response IP 139.180.191.154
Found Yes
Hash 5c4f7ad66ed342af0bdfe25135249b382c6307eccdfbc9d2fe4a06fbe8a28693
SimHash f01c900381a0

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ezoicbot-nicheiq

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /