romancart.com
robots.txt

Robots Exclusion Standard data for romancart.com

Resource Scan

Scan Details

Site Domain romancart.com
Base Domain romancart.com
Scan Status Ok
Last Scan2024-05-22T21:23:49+00:00
Next Scan 2024-06-21T21:23:49+00:00

Last Scan

Scanned2024-05-22T21:23:49+00:00
URL https://romancart.com/robots.txt
Domain IPs 104.26.10.90, 104.26.11.90, 172.67.69.132, 2606:4700:20::681a:a5a, 2606:4700:20::681a:b5a, 2606:4700:20::ac43:4584
Response IP 172.67.69.132
Found Yes
Hash 825c686d468cea5f694adc1656a3d350a3afb6e29ae4231879ed158d98de2d18
SimHash ca56c9c0b628

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /demo/
Disallow /payment/
Disallow /cart.asp
Disallow /cartinfo.asp

yandex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /payment/
Disallow /cart.asp
Disallow /cartinfo.asp

adsbot-google

Rule Path
Disallow /payment/
Disallow /cart.asp
Disallow /cartinfo.asp

Comments

  • Prevent robots parsing the demo shop.

Warnings

  • 2 invalid lines.