maintenance.flysafair.co.za
robots.txt

Robots Exclusion Standard data for maintenance.flysafair.co.za

Resource Scan

Scan Details

Site Domain maintenance.flysafair.co.za
Base Domain flysafair.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-25T20:43:48+00:00
Next Scan 2024-06-23T20:43:48+00:00

Last Successful Scan

Scanned2023-11-04T19:58:31+00:00
URL https://maintenance.flysafair.co.za/robots.txt
Domain IPs 172.66.40.136, 172.66.43.120, 2606:4700:3108::ac42:2888, 2606:4700:3108::ac42:2b78
Response IP 172.66.40.136
Found Yes
Hash b13cc90bb43c30c52dd4e81e3a1e17824b42d80abe15426998de5987b09ca20d
SimHash a1da5b68eeb3

Groups

pingdom

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

*

Rule Path
Disallow /N2/
Disallow /images/
Disallow /flight/
Disallow /app/
Disallow /employee-login
Disallow /mini-profiler-resources
Disallow /ErrorPage
Disallow /*?promocode=*
Disallow /wallpaper-downloads
Disallow /travel-tools/extras/sanlam-reality

Other Records

Field Value
sitemap https://www.flysafair.co.za/sitemap.xml