bellesafilms.com
robots.txt

Robots Exclusion Standard data for bellesafilms.com

Resource Scan

Scan Details

Site Domain bellesafilms.com
Base Domain bellesafilms.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-16T09:18:37+00:00
Next Scan 2024-06-14T09:18:37+00:00

Last Successful Scan

Scanned2023-04-25T05:56:48+00:00
URL https://bellesafilms.com/robots.txt
Domain IPs 104.26.12.103, 104.26.13.103, 172.67.68.49, 2606:4700:20::681a:c67, 2606:4700:20::681a:d67, 2606:4700:20::ac43:4431
Response IP 172.67.68.49
Found Yes
Hash 3e5c1ae2556db30d3e233a342fe02e7e5c2d964da0c69283319f00b2022a995a
SimHash 27099c504933

Groups

*
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yandex

Rule Path
Disallow /*?sortby=*
Disallow /*%26sortby%3D*
Disallow /*?letter=*
Disallow /*%26letter%3D*
Disallow /*%26page%3D*
Allow /models?sortby=*

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.bellesafilms.com/sitemaps.xml