gptgirlfriend.online
robots.txt

Robots Exclusion Standard data for gptgirlfriend.online

Resource Scan

Scan Details

Site Domain gptgirlfriend.online
Base Domain gptgirlfriend.online
Scan Status Ok
Last Scan2024-09-19T04:09:04+00:00
Next Scan 2024-10-19T04:09:04+00:00

Last Scan

Scanned2024-09-19T04:09:04+00:00
URL https://gptgirlfriend.online/robots.txt
Redirect https://www.gptgirlfriend.online/robots.txt
Redirect Domain www.gptgirlfriend.online
Redirect Base gptgirlfriend.online
Domain IPs 104.26.0.242, 104.26.1.242, 172.67.68.76, 2606:4700:20::681a:1f2, 2606:4700:20::681a:f2, 2606:4700:20::ac43:444c
Redirect IPs 104.26.0.242, 104.26.1.242, 172.67.68.76, 2606:4700:20::681a:1f2, 2606:4700:20::681a:f2, 2606:4700:20::ac43:444c
Response IP 104.26.0.242
Found Yes
Hash fd117e4bcf91aa6759467f1851b8654ec46ffe698ebdbe361ceba3f3ded96e08
SimHash c01c84424fb0

Groups

*

Rule Path
Allow /
Disallow /get/

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gptgirlfriend.online/sitemap.xml

Warnings

  • `host` is not a known field.