flyprat.no
robots.txt

Robots Exclusion Standard data for flyprat.no

Resource Scan

Scan Details

Site Domain flyprat.no
Base Domain flyprat.no
Scan Status Ok
Last Scan2024-09-28T02:17:44+00:00
Next Scan 2024-10-05T02:17:44+00:00

Last Scan

Scanned2024-09-28T02:17:44+00:00
URL https://flyprat.no/robots.txt
Redirect https://forum.flyprat.no/robots.txt
Redirect Domain forum.flyprat.no
Redirect Base flyprat.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 108.157.254.128, 108.157.254.17, 108.157.254.49, 108.157.254.59, 2600:9000:2753:6000:2:7879:5580:93a1, 2600:9000:2753:7400:2:7879:5580:93a1, 2600:9000:2753:9000:2:7879:5580:93a1, 2600:9000:2753:bc00:2:7879:5580:93a1, 2600:9000:2753:c400:2:7879:5580:93a1, 2600:9000:2753:c600:2:7879:5580:93a1, 2600:9000:2753:d400:2:7879:5580:93a1, 2600:9000:2753:e800:2:7879:5580:93a1
Response IP 108.157.254.17
Found Yes
Hash 33d2af760601024de61625aee6a608f1fdbd65dbd2a9601c721cdb87ded5d72e
SimHash a12c425d828e

Groups

*

Rule Path
Disallow /ajax.php
Disallow /ajax_cron.php
Disallow /attachment.php
Disallow /checkspelling.php
Disallow /cron.php
Disallow /editpost.php
Disallow /external.php
Disallow /faq.php
Disallow /global.php
Disallow /image.php
Disallow /joinrequest.php
Disallow /login.php
Disallow /member.php
Disallow /misc.php
Disallow /moderator.php
Disallow /newattatchment.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /payment_gateway.php
Disallow /payments.php
Disallow /pdfthread.php
Disallow /poll.php
Disallow /postings.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendmessage.php
Disallow /subcription.php
Disallow /subcriptions.php
Disallow /threadrate.php
Disallow /usercp.php
Disallow /usernote.php
Disallow /admincp/
Disallow /modcp/
Disallow /articlebot/
Disallow /customavatars/
Disallow /customprofilepics/
Disallow /files/
Disallow /install/
Disallow /cpstyles/
Disallow /includes/
Disallow /subscriptions/
Disallow /attachments/
Disallow /frm_attach/
Disallow /vbweather/
Disallow /post.php

Other Records

Field Value
crawl-delay 5

newspointbot

Rule Path
Disallow /

whitevector crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /