filmmakermagazine.com
robots.txt

Robots Exclusion Standard data for filmmakermagazine.com

Resource Scan

Scan Details

Site Domain filmmakermagazine.com
Base Domain filmmakermagazine.com
Scan Status Ok
Last Scan2024-11-11T02:52:36+00:00
Next Scan 2024-11-18T02:52:36+00:00

Last Scan

Scanned2024-11-11T02:52:36+00:00
URL https://filmmakermagazine.com/robots.txt
Domain IPs 104.26.0.65, 104.26.1.65, 172.67.72.116, 2606:4700:20::681a:141, 2606:4700:20::681a:41, 2606:4700:20::ac43:4874
Response IP 104.26.1.65
Found Yes
Hash 2b4d248660bc530b010e95494d8b46a1475370f1de6a106c72537aad70bbf3c4
SimHash ab5abaa2e212

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /ftpaccount/
Disallow /blog/
Disallow /blogger/
Disallow /libs/
Disallow /simplepie/
Disallow /simplepie-cache/
Disallow /styles/
Disallow /unused/
Disallow /directorinterviews/
Disallow /gotham-awards/

Other Records

Field Value
crawl-delay 1

zibber-v0.1(www.zibb.com/crawler/)

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

Other Records

Field Value
sitemap http://filmmakermagazine.com/sitemap.xml