dspotlight.com
robots.txt

Robots Exclusion Standard data for dspotlight.com

Resource Scan

Scan Details

Site Domain dspotlight.com
Base Domain dspotlight.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-05T23:45:11+00:00
Next Scan 2024-06-12T23:45:11+00:00

Last Successful Scan

Scanned2023-10-10T21:11:42+00:00
URL https://dspotlight.com/robots.txt
Redirect https://www.dspotlight.com/robots.txt
Redirect Domain www.dspotlight.com
Redirect Base dspotlight.com
Domain IPs 104.26.8.60, 104.26.9.60, 172.67.71.206, 2606:4700:20::681a:83c, 2606:4700:20::681a:93c, 2606:4700:20::ac43:47ce
Redirect IPs 104.26.8.60, 104.26.9.60, 172.67.71.206, 2606:4700:20::681a:83c, 2606:4700:20::681a:93c, 2606:4700:20::ac43:47ce
Response IP 104.26.8.60
Found Yes
Hash a4319e838d852fae26ba7812ff3dc2e4057b006ff7d8e7d045f5179d9d7a7ed7
SimHash 61019960c711

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.dspotlight.com/sitemap.xml