Log In Sign Up

biddytarot.com
robots.txt

Robots Exclusion Standard data for biddytarot.com

Resource Scan

Scan Details

Site Domain biddytarot.com
Base Domain biddytarot.com
Scan Status Ok
Last Scan2024-09-18T09:18:14+00:00
Next Scan 2024-09-25T09:18:14+00:00

Last Scan

Scanned2024-09-18T09:18:14+00:00
URL https://biddytarot.com/robots.txt
Domain IPs 104.26.10.72, 104.26.11.72, 172.67.70.75, 2606:4700:20::681a:a48, 2606:4700:20::681a:b48, 2606:4700:20::ac43:464b
Response IP 104.26.10.72
Found Yes
Hash 3178786c2ee3b8c2525e29e8c5819b63605f609709f4f93a4f1153789b275070
SimHash 9020c92329b6

Groups

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://biddytarot.com/sitemap_index.xml
Back to top

Comments

  • ======Raptive Begin======
  • ======Raptive End======
  • www.SEOnational.com
  • BOTS
  • Line below tells all bots they can crawl site.
  • SITEMAP(S)
  • Leave the line below for all sites,
  • but update/confirm the sitemap's relative path.
  • The sitemap path below is Yoast's.
  • IMPORTANT: must be full url below,
  • not just /sitemap_index.xml
Back to top