{"version":"1.0","provider_name":"Blog - Buddy Infotech","provider_url":"https:\/\/buddyinfotech.in\/blog","author_name":"Buddy Infotech","author_url":"https:\/\/buddyinfotech.in\/blog\/author\/buddyinfo-pankaj\/","title":"Robots.txt Guide for Beginners - Blog - Buddy Infotech","type":"rich","width":600,"height":338,"html":"<blockquote class=\"wp-embedded-content\" data-secret=\"BwlyRz9ie0\"><a href=\"https:\/\/buddyinfotech.in\/blog\/robots-txt-guide-for-beginners\/\">Robots.txt Guide for Beginners<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/buddyinfotech.in\/blog\/robots-txt-guide-for-beginners\/embed\/#?secret=BwlyRz9ie0\" width=\"600\" height=\"338\" title=\"&#8220;Robots.txt Guide for Beginners&#8221; &#8212; Blog - Buddy Infotech\" data-secret=\"BwlyRz9ie0\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script type=\"text\/javascript\">\n\/* <![CDATA[ *\/\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/\/# sourceURL=https:\/\/buddyinfotech.in\/blog\/wp-includes\/js\/wp-embed.min.js\n\/* ]]> *\/\n<\/script>\n","description":"Robots.txt Guide for Beginners If you\u2019re just getting started with SEO, the term robots.txt might sound like something meant only for developers. But don\u2019t let the technical name scare you\u2014it\u2019s actually a pretty simple concept once you understand what it does. Think of robots.txt as a set of instructions for search engine bots visiting your [&hellip;]"}