af3.azureedge.net
robots.txt

Robots Exclusion Standard data for af3.azureedge.net

Resource Scan

Scan Details

Site Domain af3.azureedge.net
Base Domain azureedge.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-05T20:41:32+00:00
Next Scan 2024-07-04T20:41:32+00:00

Last Successful Scan

Scanned2023-05-15T13:28:11+00:00
URL https://af3.azureedge.net/robots.txt
Domain IPs 13.107.237.59, 13.107.238.59, 2620:1ec:4e:1::59, 2620:1ec:4f:1::59
Response IP 13.107.213.59
Found Yes
Hash 0a6e2aaf6ec1e4b6785e652c014d39014da6183adb2a215e35418d47de6cbfb8
SimHash 0476c31cf397

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /email_template/
Disallow /include/
Disallow /js/
Disallow /lang/
Disallow /players/
Disallow /plugins/
Disallow /Smarty/
Disallow /templates/
Disallow /404.php
Disallow /ajax.php
Disallow /ajax_search.php
Disallow /censor_words.txt
Disallow /comment.php
Disallow /config.php
Disallow /cron.php
Disallow /view.php
Disallow /edit-video.php
Disallow /edit_profile.php
Disallow /embed.php
Disallow /embed/
Disallow /emoji-help.php
Disallow /fpembed.php
Disallow /login.php
Disallow /register.php
Disallow /relatedclips.php
Disallow /social-thumb.php
Disallow /suggest.php
Disallow /upload.php
Disallow /user.php
Disallow /videoads.php
Disallow /topvideos.php
Disallow /mobile/
Allow /uploads/thumbs

all

Rule Path
Allow /

googlebot

Rule Path
Allow /*

googlebot-video

Rule Path
Allow /*

googlebot-image

Rule Path
Allow /*

mediapartners-google

Rule Path
Allow /*

googlebot-mobile

Rule Path
Allow /*

googlebot-video

Rule Path
Allow /*

ia_archiver-web.archive.org

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /