What would a robot say? Beep Bop Boop helps detect ROBOTS.TXT and NOINDEX, NOFOLLOW info for the current web page.
Beep Bop Boop is a simple, experimental developer tool used in-house by Human Element, inc:
By clicking the extension icon, you can quickly see a web page's robots meta tag information AND robots.txt file. This way you can quickly see whether a web page should be crawled by search engines. If you maintain development sites that should be hidden from search engines, Beep Bop Boop can help you verify that both robots.txt and the meta tags are configured correctly, for development sites versus production sites.
We are open to feedback and suggestions, but we do not guarantee we will respond to requests nor implement them. We only want to share an experimental tool with the world for free.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED
TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL
THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF
CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
DEALINGS IN THE SOFTWARE.