spilsby.online
robots.txt

Robots Exclusion Standard data for spilsby.online

Resource Scan

Scan Details

Site Domain spilsby.online
Base Domain spilsby.online
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-26T20:43:26+00:00
Next Scan 2025-05-27T20:43:26+00:00

Last Successful Scan

Scanned2023-02-07T14:14:30+00:00
URL https://spilsby.online/robots.txt
Domain IPs 104.21.91.137, 172.67.220.237, 2606:4700:3030::ac43:dced, 2606:4700:3034::6815:5b89
Response IP 172.67.220.237
Found Yes
Hash aa722be59aa1b1db8074eb1388033c9a522d80d3c11e08450ac857cce81f24ff
SimHash e3008a324bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/sabai/
Allow /wp-content/sabai/File/thumbnails/
Disallow /wp-content/plugins/sabai/
Disallow /wp-content/plugins/sabai-directory/
Disallow /wp-content/plugins/sabai-googlemaps/
Disallow /wp-content/plugins/sabai-paidlistings/

Other Records

Field Value
sitemap https://spilsby.online/sitemap_index.xml
sitemap https://spilsby.online/sabai-sitemap-index.xml