nextsportsweb.com
robots.txt

Robots Exclusion Standard data for nextsportsweb.com

Resource Scan

Scan Details

Site Domain nextsportsweb.com
Base Domain nextsportsweb.com
Scan Status Ok
Last Scan2024-05-19T19:42:27+00:00
Next Scan 2024-06-18T19:42:27+00:00

Last Scan

Scanned2024-05-19T19:42:27+00:00
URL https://nextsportsweb.com/robots.txt
Domain IPs 13.32.251.115, 13.32.251.129, 13.32.251.32, 13.32.251.63, 2600:9000:2200:1e00:f:7ef1:bd00:93a1, 2600:9000:2200:4c00:f:7ef1:bd00:93a1, 2600:9000:2200:600:f:7ef1:bd00:93a1, 2600:9000:2200:6200:f:7ef1:bd00:93a1, 2600:9000:2200:6e00:f:7ef1:bd00:93a1, 2600:9000:2200:8a00:f:7ef1:bd00:93a1, 2600:9000:2200:9400:f:7ef1:bd00:93a1, 2600:9000:2200:ce00:f:7ef1:bd00:93a1
Response IP 108.157.254.59
Found Yes
Hash deec29c018c7fea7e909c4da2226ae7dbc0402073ec66747b89c2e4aff34d9d8
SimHash 38089cc0ea9a

Groups

*

Rule Path
Disallow /.well-known/*
Disallow /dist/*

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60