superiorsolos.com
robots.txt

Robots Exclusion Standard data for superiorsolos.com

Resource Scan

Scan Details

Site Domain superiorsolos.com
Base Domain superiorsolos.com
Scan Status Ok
Last Scan2024-11-16T18:01:28+00:00
Next Scan 2024-11-23T18:01:28+00:00

Last Scan

Scanned2024-11-16T18:01:28+00:00
URL https://superiorsolos.com/robots.txt
Domain IPs 104.21.73.69, 172.67.158.184, 2606:4700:3035::ac43:9eb8, 2606:4700:3037::6815:4945
Response IP 172.67.158.184
Found Yes
Hash fcc68c0182fc7f59b299381777659a56af4764d3e01a9dbf4011b5b59384503a
SimHash 4815353577d6

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

adsbot-google
bingpreview
deepcrawl
googlebot
googlebot-image
googlebot-mobile
mediapartners-google
stc-bot
searchmetricsbot
yahoo! slurp
archive.org_bot
bingbot
ia_archiver

Rule Path
Disallow /1014943
Disallow /3584794
Disallow /5787254
Disallow /ad_acknowledgment
Disallow /ad_spice
Disallow /ad_syndication_user_tracking
Disallow /ad_visibility
Disallow /adredir?
Disallow /adtrack
Disallow /advertise?
Disallow /bookmark?
Disallow /browse/reviews/recent
Disallow /client_errors
Disallow /csp_block
Disallow /csp_report_only
Disallow /dtc_redir
Disallow /elite?
Disallow /events
Disallow /events/export/
Disallow /facebook_connect
Disallow /flag_content?
Disallow /gamtarget
Disallow /location_suggest
Disallow /mail?
Disallow /menu/*/feedback_form
Disallow /message_the_business
Disallow /mss/review_feedback/
Disallow /mtb_composer
Disallow /not_recommended_reviews/preview
Disallow /possible_biz_owner
Disallow /proredir?
Disallow /px.gif
Disallow /redir?
Disallow /review_feed_auto_fetch
Disallow /search_suggest
Disallow /send_to_friend
Disallow /sit_rep
Disallow /spice
Disallow /start_order
Disallow /syndicate
Disallow /talk/new_topic
Disallow /thanx?

yahoo! slurp
bingbot

Rule Path
Disallow /search*start%3D

Other Records

Field Value
sitemap https://superiorsolos.com/sitemap_index.xml

Comments

  • If you would like to inquire about crawling Yelp, please contact us at
  • https://superiorsolos.com/
  • 1. A robot may not injure a human being or, through inaction, allow a human
  • being to come to harm.
  • 2. A robot must obey orders given it by human beings except where such
  • orders would conflict with the First Law.
  • 3. A robot must protect its own existence as long as such protection does
  • not conflict with the First or Second Law.