uppladdning.nu
robots.txt

Robots Exclusion Standard data for uppladdning.nu

Resource Scan

Scan Details

Site Domain uppladdning.nu
Base Domain uppladdning.nu
Scan Status Ok
Last Scan2024-09-27T04:33:34+00:00
Next Scan 2024-10-04T04:33:34+00:00

Last Scan

Scanned2024-09-27T04:33:34+00:00
URL https://uppladdning.nu/robots.txt
Domain IPs 52.138.196.70
Response IP 52.138.196.70
Found Yes
Hash a5d660453da8a59b4c3ba834322abe29fd6767649922a044f675fdcee57d87ff
SimHash 0045dd8165d4

Groups

googlebot
slurp
msnbot
mediapartners-google*
googlebot-image
yahoo-mmcrawler

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow *

Other Records

Field Value
crawl-delay 60

Comments

  • block all others
  • Block Femtosearch for being too aggressive! 38.126.157.45

Warnings

  • 2 invalid lines.