travelark.org
robots.txt

Robots Exclusion Standard data for travelark.org

Resource Scan

Scan Details

Site Domain travelark.org
Base Domain travelark.org
Scan Status Ok
Last Scan2024-11-06T10:25:24+00:00
Next Scan 2024-12-06T10:25:24+00:00

Last Scan

Scanned2024-11-06T10:25:24+00:00
URL https://travelark.org/robots.txt
Domain IPs 34.232.252.222
Response IP 34.232.252.222
Found Yes
Hash ddb3744178708ff134615f7f857fac23558f955c21fac8e452929f3364a470c3
SimHash 512d916a0440

Groups

*

Rule Path
Allow /$
Disallow /
Disallow /akamai/
Disallow /cgi-bin/suggest_city_gm.pl
Disallow /cgi-bin/accommodations-reviews.pl
Disallow /cgi-bin/add_fav.cgi
Disallow /cgi-bin/admin.pl
Disallow /cgi-bin/ad_servlet.pl
Disallow /cgi-bin/ajax-ad.pl
Disallow /cgi-bin/auto_subscribe1.pl
Disallow /cgi-bin/backup_entry.cgi
Disallow /cgi-bin/ct
Disallow /dashboard
Disallow /cgi-bin/delete_comment.pl
Disallow /cgi-bin/delete_post.pl
Disallow /cgi-bin/directory.pl/ad/
Disallow /cgi-bin/edit_entry.cgi
Disallow /cgi-bin/email_this_photo
Disallow /cgi-bin/entries.pl
Disallow /cgi-bin/feedback1.pl
Disallow /travelblogs-find/cities/
Disallow /cgi-bin/google_ad_servlet.pl
Disallow /cgi-bin/images.pl
Disallow /cgi-bin/index-old.cgi
Disallow /cgi-bin/m_feedback1.pl
Disallow /cgi-bin/maps.pl
Disallow /cgi-bin/map-entry.cgi
Disallow /cgi-bin/map-small-world.cgi
Disallow /cgi-bin/new_comment1.pl
Disallow /cgi-bin/new_comment2.pl
Disallow /cgi-bin/new_post1.pl
Disallow /cgi-bin/new_post2.pl
Disallow /cgi-bin/notify_remove_form.pl
Disallow /cgi-bin/search_photo_keyword2.cgi
Disallow /cgi-bin/search_photo_slideshow.cgi
Disallow /help/travelstream
Disallow /help/faq
Disallow /jobs
Disallow /cgi-bin/witw
Disallow /cgi-bin/ta-redirect.cgi
Disallow /cgi-bin/airwatch.pl
Disallow /cgi-bin/ta_ad_servlet.pl
Disallow /cgi-bin/view_printer.pl
Disallow /cgi-bin/vote_trip1.pl
Disallow /cgi-bin/upload_img2.pl
Disallow /makethecut/
Disallow /more_site_nav.html
Disallow /print-travel-blog
Disallow /travel-blog-slideshow
Disallow /travelers/
Disallow /s-like/
Disallow /s/travelers/
Disallow /s/videos/
Disallow /s/blogs/
Disallow /s/forums/
Disallow /s/attractions/
Disallow /s/trips/
Disallow /s/hotels/
Disallow /continue
Disallow /tools/
Disallow /attraction_photo/
Disallow /hotel_photo/
Disallow /feedback
Disallow /xd_receiver.htm
Disallow /login/facebook
Disallow /login/header
Disallow /app/
Disallow /reviewbucket/iframe/1
Disallow /cgi-bin/iq-redir.cgi
Disallow /tripwow/js-exception/
Disallow /tw_slides/temp-uploads/
Disallow /tw_slides2/temp-uploads/
Disallow /tw_slides3/temp-uploads/
Disallow /tw_slides4/temp-uploads/
Disallow /tripwow/ping/
Disallow /tripwow/*/ping/
Disallow /tripwow/*/xml?
Disallow /slideshow
Disallow /mobilecheckrates
Disallow /blog/related-tags.php
Disallow /blog/next/
Disallow /blog/activate/
Disallow /blog/signup/
Disallow /blog/cgi-bin/
Disallow /travel-blog-sites/related-tags.php
Disallow /travel-blog-sites/next/
Disallow /travel-blog-sites/activate/
Disallow /travel-blog-sites/signup/
Disallow /travel-blog-sites/cgi-bin/
Disallow /adp.html
Disallow /traveler-iq/patch
Disallow /syndication
Disallow /hotels/data/

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gosospider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou pic

Rule Path
Disallow /

sogou head

Rule Path
Disallow /

sogou web

Rule Path
Disallow /

sogou orion

Rule Path
Disallow /

sogou-test-spider

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

superfeedr

Rule Path
Disallow /

Warnings

  • 2 invalid lines.