planefinder.net
robots.txt

Robots Exclusion Standard data for planefinder.net

Resource Scan

Scan Details

Site Domain planefinder.net
Base Domain planefinder.net
Scan Status Ok
Last Scan2024-06-13T22:10:06+00:00
Next Scan 2024-06-20T22:10:06+00:00

Last Scan

Scanned2024-06-13T22:10:06+00:00
URL https://planefinder.net/robots.txt
Domain IPs 104.17.171.7, 104.17.172.7, 2606:4700::6811:ab07, 2606:4700::6811:ac07
Response IP 104.17.171.7
Found Yes
Hash a5033b614015aa291806285d69573f3d9c06b8306821304dc23e4d37bf9b0fc0
SimHash 5b0dc240c532

Groups

*

Rule Path
Disallow /mobile.php
Disallow /about/category/news*
Disallow /about/hello-world*
Disallow /?bounds=*
Disallow /flightstat/v1/*
Disallow /golden-ticket/*
Disallow /search/*
Disallow /static-map/*
Disallow /api/*
Disallow /share/*

yandex

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

twitterbot

Rule Path
Allow /share/*

facebookexternalhit

Rule Path
Allow /share/*
Disallow /data/*
Disallow /flight/*
Disallow /about/*

Other Records

Field Value
sitemap https://planefinder.net/sitemap.xml
sitemap https://planefinder.net/data/data-sitemap.xml