forum.flyprat.no
robots.txt

Robots Exclusion Standard data for forum.flyprat.no

Resource Scan

Scan Details

Site Domain forum.flyprat.no
Base Domain flyprat.no
Scan Status Ok
Last Scan2024-08-31T14:57:09+00:00
Next Scan 2024-09-30T14:57:09+00:00

Last Scan

Scanned2024-08-31T14:57:09+00:00
URL https://forum.flyprat.no/robots.txt
Domain IPs 108.157.254.128, 108.157.254.17, 108.157.254.49, 108.157.254.59, 2600:9000:2753:1e00:2:7879:5580:93a1, 2600:9000:2753:6e00:2:7879:5580:93a1, 2600:9000:2753:7200:2:7879:5580:93a1, 2600:9000:2753:a600:2:7879:5580:93a1, 2600:9000:2753:b600:2:7879:5580:93a1, 2600:9000:2753:be00:2:7879:5580:93a1, 2600:9000:2753:d600:2:7879:5580:93a1, 2600:9000:2753:fe00:2:7879:5580:93a1
Response IP 108.157.254.59
Found Yes
Hash 8c2a35903d16cfb29dd03372a9befb6715181c048628ffbbea2953c04f053cc0
SimHash a12c0acdca8e

Groups

*

Rule Path
Disallow /ajax.php
Disallow /ajax_cron.php
Disallow /attachment.php
Disallow /checkspelling.php
Disallow /cron.php
Disallow /editpost.php
Disallow /external.php
Disallow /faq.php
Disallow /global.php
Disallow /image.php
Disallow /joinrequest.php
Disallow /login.php
Disallow /member.php
Disallow /misc.php
Disallow /moderator.php
Disallow /newattatchment.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /payment_gateway.php
Disallow /payments.php
Disallow /pdfthread.php
Disallow /poll.php
Disallow /postings.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendmessage.php
Disallow /subcription.php
Disallow /subcriptions.php
Disallow /threadrate.php
Disallow /usercp.php
Disallow /usernote.php
Disallow /admincp/
Disallow /modcp/
Disallow /articlebot/
Disallow /customavatars/
Disallow /customprofilepics/
Disallow /files/
Disallow /install/
Disallow /cpstyles/
Disallow /includes/
Disallow /subscriptions/
Disallow /attachments/
Disallow /frm_attach/
Disallow /vbweather/
Disallow /post.php

Other Records

Field Value
crawl-delay 5

newspointbot

Rule Path
Disallow /

whitevector crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /