thefilmfund.co
robots.txt

Robots Exclusion Standard data for thefilmfund.co

Resource Scan

Scan Details

Site Domain thefilmfund.co
Base Domain thefilmfund.co
Scan Status Ok
Last Scan2024-10-05T11:41:13+00:00
Next Scan 2024-10-12T11:41:13+00:00

Last Scan

Scanned2024-10-05T11:41:13+00:00
URL https://thefilmfund.co/robots.txt
Redirect https://www.thefilmfund.co/robots.txt
Redirect Domain www.thefilmfund.co
Redirect Base thefilmfund.co
Domain IPs 67.205.19.136
Redirect IPs 67.205.19.136
Response IP 67.205.19.136
Found Yes
Hash 585ec9b187f768fbb8d81406fb87c6f9109dac3ab45e0b9927a04b55c0d6b457
SimHash 4801181247b2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://www.domain.com/sitemap_index.xml