Log In Sign Up

skottle.createaforum.com
robots.txt

Robots Exclusion Standard data for skottle.createaforum.com

Resource Scan

Scan Details

Site Domain skottle.createaforum.com
Base Domain createaforum.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-11T04:21:45+00:00
Next Scan 2025-08-12T04:21:45+00:00

Last Successful Scan

Scanned2025-07-12T04:17:11+00:00
URL https://skottle.createaforum.com/robots.txt
Domain IPs 104.26.2.113, 104.26.3.113, 172.67.73.153, 2606:4700:20::681a:271, 2606:4700:20::681a:371, 2606:4700:20::ac43:4999
Response IP 172.67.73.153
Found Yes
Hash b97ae92932689a8804a0880baf8ceb814c500da14cf0392952f6e35819af07cc
SimHash 171e54f4c235

Groups

sistrix crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

serpstatbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

facebookexternalhit/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20
Back to top