filmrakat.hu
robots.txt

Robots Exclusion Standard data for filmrakat.hu

Resource Scan

Scan Details

Site Domain filmrakat.hu
Base Domain filmrakat.hu
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-04T21:53:17+00:00
Next Scan 2024-11-03T21:53:17+00:00

Last Successful Scan

Scanned2024-07-07T21:52:07+00:00
URL https://filmrakat.hu/robots.txt
Domain IPs 185.75.192.3
Response IP 185.75.192.3
Found Yes
Hash e34bb8fbfcb613db8b00f7af09597c326ccfadeebce62ae33fe240a6080f52cf
SimHash ce25cc209eb0

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /*feed/
Allow /wp-admin/admin-ajax.php

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://filmrakat.hu/sitemap_index.xml

Comments

  • Ban bots that don't benefit us.
  • --------------------------------