theinfatuation.com
robots.txt

Robots Exclusion Standard data for theinfatuation.com

Resource Scan

Scan Details

Site Domain theinfatuation.com
Base Domain theinfatuation.com
Scan Status Ok
Last Scan2024-05-04T08:53:19+00:00
Next Scan 2024-05-18T08:53:19+00:00

Last Scan

Scanned2024-05-04T08:53:19+00:00
URL https://theinfatuation.com/robots.txt
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Response IP 216.239.32.21
Found Yes
Hash c09a2591cfffd9a70551e1bf61353ba41cbb9c568bf7fb389af04bcb66b39af7
SimHash 0710ba80a433

Groups

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow /preview/*

*

Rule Path
Disallow /login

*

Rule Path
Disallow /signup

*

Rule Path
Disallow /forgot-password

*

Rule Path
Disallow /reset-password

*

Rule Path
Disallow /profile*

*

Rule Path
Disallow /*?source*

Other Records

Field Value
sitemap https://www.theinfatuation.com/sitemap.xml
sitemap https://www.theinfatuation.com/sitemap-1.xml
sitemap https://www.theinfatuation.com/sitemap-latest.xml
sitemap https://www.theinfatuation.com/sitemap-news.xml

Comments

  • Baiduspider
  • YandexBot
  • *
  • *
  • *
  • *
  • *
  • *
  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.