secon2022.ieee-secon.org
robots.txt

Robots Exclusion Standard data for secon2022.ieee-secon.org

Resource Scan

Scan Details

Site Domain secon2022.ieee-secon.org
Base Domain ieee-secon.org
Scan Status Ok
Last Scan2024-05-20T10:18:59+00:00
Next Scan 2024-06-19T10:18:59+00:00

Last Scan

Scanned2024-05-20T10:18:59+00:00
URL https://secon2022.ieee-secon.org/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash 0b8a11852d8619cac58ec15adc4af4b2e35cc44f247f327f59782ec4dc0ccd19
SimHash 68c077736321

Groups

*

Rule Path
Disallow *post_type%3Dtribe_events*
Disallow *hide_subsequent_recurrences%3D*
Disallow *tribe-bar-date%3D*
Disallow *tribe-venue%3D*
Disallow *eventDisplay%3D*
Disallow *eventDate%3D*
Disallow *paged%3D*
Disallow *pagename%3D*
Disallow *shortcode%3D*
Disallow *ical%3D*
Disallow *outlook-ical%3D*
Disallow *related_series%3D*
Disallow *tribe_geofence%3D*
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /program-2/action~posterboard/
Disallow /program-2/action~agenda/
Disallow /program-2/action~oneday/
Disallow /program-2/action~month/
Disallow /program-2/action~week/
Disallow /program-2/action~stream/
Disallow /program-2/action~undefined/
Disallow /program-2/action~http%3A/
Disallow /program-2/action~default/
Disallow /program-2/action~poster/
Disallow /program-2/action~*/

Other Records

Field Value
crawl-delay 20

applebot

Rule Path
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /hashtag/
Disallow /l.php
Disallow /live/
Disallow /moments_app/
Disallow /p.php
Disallow /photo.php
Disallow /photos.php
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/

baiduspider
bingbot
googlebot
googlebot-image

Rule Path
Disallow /map_tile.php
Disallow /static_map.php

ia_archiver

Rule Path
Disallow /

msnbot
naverbot
seznambot
slurp
teoma
twitterbot
yandex
yeti

Rule Path
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /safetycheck/
Allow /about/privacy
Allow /full_data_use_policy
Allow /legal/terms
Allow /policy.php
Disallow /test/action~posterboard/
Disallow /test/action~agenda/
Disallow /test/action~oneday/
Disallow /test/action~month/
Disallow /test/action~week/
Disallow /test/action~stream/
Disallow /test/action~undefined/
Disallow /test/action~http%3A/
Disallow /test/action~default/
Disallow /test/action~poster/
Disallow /test/action~*/
Disallow /program/action~posterboard/
Disallow /program/action~agenda/
Disallow /program/action~oneday/
Disallow /program/action~month/
Disallow /program/action~week/
Disallow /program/action~stream/
Disallow /program/action~undefined/
Disallow /program/action~http%3A/
Disallow /program/action~default/
Disallow /program/action~poster/
Disallow /program/action~*/

Comments

  • Notice: Crawling Facebook is prohibited unless you have express written
  • permission. See: http://www.facebook.com/apps/site_scraping_tos_terms.php