bargpt.app
robots.txt

Robots Exclusion Standard data for bargpt.app

Resource Scan

Scan Details

Site Domain bargpt.app
Base Domain bargpt.app
Scan Status Ok
Last Scan2024-11-16T10:07:53+00:00
Next Scan 2024-11-23T10:07:53+00:00

Last Scan

Scanned2024-11-16T10:07:53+00:00
URL https://bargpt.app/robots.txt
Redirect https://www.bargpt.app/robots.txt
Redirect Domain www.bargpt.app
Redirect Base bargpt.app
Domain IPs 76.76.21.22, 76.76.21.241
Redirect IPs 76.76.21.164, 76.76.21.98
Response IP 76.76.21.22
Found Yes
Hash 27dc4b175ee1ae146e8b6c17170f5bb47889de372d277afdf237dd36e9633463
SimHash 0955da004f51

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /user
Disallow /user/*
Disallow /tos
Disallow /privacy-policy
Disallow /server-sitemap-index.xml
Disallow /contact-us
Disallow /search/*

Other Records

Field Value
sitemap https://www.bargpt.app/sitemap.xml
sitemap https://www.bargpt.app/server-sitemap.xml

Comments

  • *
  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.