Log In Sign Up

tarotica.com
robots.txt

Robots Exclusion Standard data for tarotica.com

Resource Scan

Scan Details

Site Domain tarotica.com
Base Domain tarotica.com
Scan Status Ok
Last Scan2024-09-21T08:55:48+00:00
Next Scan 2024-09-28T08:55:48+00:00

Last Scan

Scanned2024-09-21T08:55:48+00:00
URL https://tarotica.com/robots.txt
Domain IPs 104.21.50.195, 172.67.210.8, 2606:4700:3031::ac43:d208, 2606:4700:3036::6815:32c3
Response IP 172.67.210.8
Found Yes
Hash 33080f94e97e2697ad9822c1366629e2229634cf31b3136d389c194074085468
SimHash 0174d050d7d4

Groups

*

Rule Path
Disallow /templates/

mediapartners-google

Rule Path
Allow /templates/

googlebot

Rule Path
Disallow /widgets/
Disallow /sitemap/

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 12
Back to top

Warnings

  • `nofollow` is not a known field.
  • `noindex` is not a known field.
Back to top