stillsurge.com
robots.txt

Robots Exclusion Standard data for stillsurge.com

Resource Scan

Scan Details

Site Domain stillsurge.com
Base Domain stillsurge.com
Scan Status Ok
Last Scan2024-09-18T01:33:37+00:00
Next Scan 2024-10-18T01:33:37+00:00

Last Scan

Scanned2024-09-18T01:33:37+00:00
URL https://stillsurge.com/robots.txt
Domain IPs 18.155.68.103, 18.155.68.115, 18.155.68.21, 18.155.68.76, 2600:9000:23d2:1000:7:a267:d8c0:93a1, 2600:9000:23d2:5000:7:a267:d8c0:93a1, 2600:9000:23d2:8200:7:a267:d8c0:93a1, 2600:9000:23d2:8800:7:a267:d8c0:93a1, 2600:9000:23d2:a000:7:a267:d8c0:93a1, 2600:9000:23d2:b800:7:a267:d8c0:93a1, 2600:9000:23d2:c200:7:a267:d8c0:93a1, 2600:9000:23d2:ee00:7:a267:d8c0:93a1
Response IP 18.155.68.103
Found Yes
Hash deec29c018c7fea7e909c4da2226ae7dbc0402073ec66747b89c2e4aff34d9d8
SimHash 38089cc0ea9a

Groups

*

Rule Path
Disallow /.well-known/*
Disallow /dist/*

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60