Log In Sign Up

simply-porn.com
robots.txt

Robots Exclusion Standard data for simply-porn.com

Resource Scan

Scan Details

Site Domain simply-porn.com
Base Domain simply-porn.com
Scan Status Ok
Last Scan2024-06-02T02:49:13+00:00
Next Scan 2024-07-02T02:49:13+00:00

Last Scan

Scanned2024-06-02T02:49:13+00:00
URL https://simply-porn.com/robots.txt
Redirect https://www.simply-porn.com/robots.txt
Redirect Domain www.simply-porn.com
Redirect Base simply-porn.com
Domain IPs 104.26.14.90, 104.26.15.90, 172.67.68.164, 2606:4700:20::681a:e5a, 2606:4700:20::681a:f5a, 2606:4700:20::ac43:44a4
Redirect IPs 104.26.14.90, 104.26.15.90, 172.67.68.164, 2606:4700:20::681a:e5a, 2606:4700:20::681a:f5a, 2606:4700:20::ac43:44a4
Response IP 104.26.15.90
Found Yes
Hash 87ecdb76fb4b81dc12af35b2f5a5e73f147d6d606e67065685b083cda15ba975
SimHash ba850d8d7650

Groups

*

Rule Path
Disallow /search
Back to top

Other Records

Field Value
sitemap https://api.simply-porn.com/sitemaps/simply-porn/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top