Search Engine Optimization will surely bring in traffic to a website, but note that S.E.O and S.E.M are just two parts of a marketing mix. It is just a part of online marketing strategy that has to be carefully implemented in a marketing campaign. It is found that many site owners do not get potential customers in spite of high ranks in search engines.
Loading
Showing posts with label Search Engine Optimization. Show all posts
Showing posts with label Search Engine Optimization. Show all posts
Monday, October 12, 2009
What is robots.txt file
The Secret of robots.txt in the eyes of Search Engines!
Read for creating error free robots.txt
Read for creating error free robots.txt
Although the robots.txt file is a very important file if you want to have a good ranking on search engines, many Web sites don't offer this file.
If your Web site doesn't have a robots.txt file yet, read on to learn how to create one. If you already have a robots.txt file, read our tips to make sure that it doesn't contain errors.
If your Web site doesn't have a robots.txt file yet, read on to learn how to create one. If you already have a robots.txt file, read our tips to make sure that it doesn't contain errors.
What is robots.txt?
Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit. Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site (i.e. it is not a firewall, or a kind of password protection) and the fact that you put a robots.txt file is something like putting a note “Please, do not enter” on an unlocked door – e.g. you cannot prevent thieves from coming in but the good guys will not open to door and enter. That is why we say that if you have really sen sitive data, it is too naïve to rely on robots.txt to protect it from being indexed and displayed in search results.
Locations of robots.txt
The location of robots.txt is very important. It must be in the main directory because otherwise user agents (search engines) will not be able to find it – they do not search the whole site for a file named robots.txt. Instead, they look first in the main directory (i.e. http://mydomain.com/robots.txt) and if they don't find it there, they simply assume that this site does not have a robots.txt file and therefore they index everything they find along the way. So, if you don't put robots.txt in the right place, do not be surprised that search engines index your whole site.
How do I create a robots.txt file?
So lets get moving. Create a regular text file called "robots.txt", and make sure it's named exactly that. This file must be uploaded to the root accessible directory of your site, not a subdirectory. It is only by following the above two rules will search engines interpret the instructions contained in the file. Deviate from this, and "robots.txt" becomes nothing more than a regular text file, like Cinderella after midnight.
Now that you know what to name your text file and where to upload it, you need to learn what to actually put in it to send commands off to search engines that follow this protocol (formally the "Robots Exclusion Protocol"). The format is simple enough for most intents and purposes: a USERAGENT line to identify the crawler in question followed by one or more DISALLOW: lines to disallow it from crawling certain parts of your site.
1. Here's a basic "robots.txt":
User-agent: *
Disallow: /
With the above declared, all robots (indicated by "*") are instructed to not index any of your pages (indicated by "/"). Most likely not what you want, but you get the idea.
2. Google's Image bot:
Lets get a little more discriminatory now. While every webmaster loves Google, you may not want Google's Image bot crawling your site's images and making them searchable online, if just to save bandwidth. The below declaration will do the trick:
User-agent: Googlebot-Image
Disallow: /
3. Disallows all Search Engines
The following disallows all search engines and robots from crawling select directories and pages:
User-agent: *
Disallow: /cgi-bin/
Disallow: /privatedir/
Disallow: /tutorials/blank.htm
4. Target multiple robots in robots.txt.
You can conditionally target multiple robots in "robots.txt." Take a look at the below:
User-agent: * Disallow: / User-agent: Googlebot Disallow: /cgi-bin/ Disallow: /privatedir/
This is interesting - here we declare that crawlers in general should not crawl any parts of our site, EXCEPT for Google, which is allowed to crawl the entire site apart from /cgi-bin/ and /privatedir/. So the rules of specificity apply, not inheritance.
5. Where can I find user agent names?
You can find user agent names in your log files by checking for requests to robots.txt. Most often, all search engine spiders should be given the same rights. in that case, use "User-agent: "*" as mentioned above.
Basic tips and tricks
1. How to disallow all spiders to index any file
If you don't want search engines to index any file of your Web site, use the following:
User-agent: *
Disallow: /
2. How to allow all search engine spiders to index all files
Use the following content for your robots.txt file if you want to allow all search engine spiders to index all files of your Web site:
User-agent: *
Disallow:
3. Where to find more complex examples.
You can find such examples with the following websites:
http://www.cnn.com/robots.txt
http://www.nytimes.com/robots.txt
http://www.spiegel.com/robots.txt
http://www.ebay.com/robots.txt
Your Web site must deal with a proper robots.txt file, if you want to have good rankings across all the search engines. Only if search engines know what to do with your pages, they can give you a good ranking though :).
Monday, October 5, 2009
Get Listed in search engines within 48 Hrs - SEO
You may have seen or heard people, claiming websites to be indexed within 48 hrs. Believe it or not, it is not miracle and this can be accomplished by some marketing tactics.
What should not be done?
Search engines provides the url where a website can be submitted for indexing. Do not waste your time in submitting your site there. According to their statement they may take up to 6 weeks for a website to be indexed. It's just a long time and wastage of your effort.
Before you know the way for a website to be listed within 48 hrs, you need to know how search engines find websites.
Search engine visits a website that is already indexed. On that site it will find all the links and follows it. Now search engine will move to next website from that list and will find further links. This is termed as crawling. By this way new websites can be included in search engine.
Now where the link of new website can be placed? For this you need to find websites that is already indexed by search engines.
1) Go to a search engine and search the keywords you are using for your website. Note down the websites whose page rank is 5 or above. Once enough links are found, try to get their contact information. Write down an email and send it. In your mail ask them to link their websites in return give them a back link to their websites. They should get good reasons to add your link in their websites. If you can manage 1 PR5 website have a link of your website, the website can be indexed within 5 days. If you get 1 PR6, your website can be indexed within 3 days. If you get 1 PR7 website, your website can be indexed within 48 hrs.
Sometimes persuading the higher rank website owner is tough. So you can purchase link from higher rank website.
2) If you have lower budget for marketing a brand new website our recommendation is go for another way which is absolutely free. With little effort and without any expense you can get lots of one way back links. All you need to do is write an article related to your website. If your website is doing job related to painting, sculptures and artists, you should write an article related to that. Once an article is written search for popular article directory and submit your article. When the article is submitted and approved, search engine will follow all the links in that website. The more articles are submitted more the website will have links pointing to your website and the more times the search engine will crawl your website.
This way you will be able to manage your website to be indexed within 48 hrs
What should not be done?
Search engines provides the url where a website can be submitted for indexing. Do not waste your time in submitting your site there. According to their statement they may take up to 6 weeks for a website to be indexed. It's just a long time and wastage of your effort.
Before you know the way for a website to be listed within 48 hrs, you need to know how search engines find websites.
Search engine visits a website that is already indexed. On that site it will find all the links and follows it. Now search engine will move to next website from that list and will find further links. This is termed as crawling. By this way new websites can be included in search engine.
Now where the link of new website can be placed? For this you need to find websites that is already indexed by search engines.
1) Go to a search engine and search the keywords you are using for your website. Note down the websites whose page rank is 5 or above. Once enough links are found, try to get their contact information. Write down an email and send it. In your mail ask them to link their websites in return give them a back link to their websites. They should get good reasons to add your link in their websites. If you can manage 1 PR5 website have a link of your website, the website can be indexed within 5 days. If you get 1 PR6, your website can be indexed within 3 days. If you get 1 PR7 website, your website can be indexed within 48 hrs.
Sometimes persuading the higher rank website owner is tough. So you can purchase link from higher rank website.
2) If you have lower budget for marketing a brand new website our recommendation is go for another way which is absolutely free. With little effort and without any expense you can get lots of one way back links. All you need to do is write an article related to your website. If your website is doing job related to painting, sculptures and artists, you should write an article related to that. Once an article is written search for popular article directory and submit your article. When the article is submitted and approved, search engine will follow all the links in that website. The more articles are submitted more the website will have links pointing to your website and the more times the search engine will crawl your website.
This way you will be able to manage your website to be indexed within 48 hrs
Labels:
Search Engine Optimization,
sem ahmedabad,
seo,
seo india
Subscribe to:
Posts (Atom)
Search-Engines
Total Pageviews
Google Translator
Followers
Top Sem Seo At Plaxo
Subscribe To My Podcast
Seo Guru
Seo-Guy
Labels
- Adsense (1)
- Adsense Earnings (1)
- Article marketing (2)
- Backlinks (1)
- Best SEO Company (10)
- Best SEO Company in India (7)
- Best Seo india (10)
- Best Seo Services (8)
- Blog Submission (1)
- blogger page title (1)
- blogger seo (6)
- Blogging (7)
- Comment on blogs (1)
- company (1)
- Content Management System (1)
- Content Writing Services (1)
- Custom Web Development India (2)
- Dedicated SEO India (5)
- Deep Link Directory Submission (1)
- Difference Between SEM (1)
- Directory Submission (1)
- expert (1)
- facebook application development (1)
- facebook applicatoin developer (1)
- facebook apps (1)
- Google Algorithms (2)
- Google Birthday (2)
- Google Birthday 2010 (1)
- google news (4)
- Google PageRank (1)
- Google PageRank Algorithm (1)
- google ranking (9)
- Google Ranking Master (2)
- Google Ranking Master 2010 (1)
- Google Ranking Master Gujarat (3)
- Google Ranking Master Gujarat 2010 (1)
- Google Ranking Master Gujarat Ahmedabad (2)
- Google Ranking Master Gujarat Ahmedabad 2010 (2)
- google seo (1)
- google seo blogger (5)
- HIRE DEDICATED SEO (1)
- Hire Iphone Developers (1)
- Hire Mobile Apps Developers (1)
- Hire PHP Developers India (1)
- Hire SEO India (6)
- hire web designer (1)
- Hire Web Developers India (1)
- internet marketing (11)
- internet marketing services india (2)
- iphone (1)
- Iphone Application Developers (1)
- Iphone Application Development (1)
- iphone course (1)
- iphone Training (1)
- iphone training Institute (1)
- Link Building (6)
- list building (1)
- Mobile Application Developers (1)
- Mobile Application Development (1)
- online marketing (1)
- online marketing industry (1)
- Online Press Release Submission (1)
- Open Source Development India (2)
- Outsourcing Window Application (1)
- PHP Application Development (2)
- Php Development India (2)
- PHP Open Source Development India (3)
- PHP Programmers India (2)
- php web application development services india (1)
- PHP Web Developers (1)
- Php Web Development (2)
- PHP web Development Company India (2)
- PHP Web Development India (4)
- PHP Web Site Development India (1)
- php website development services india (1)
- professional search engine optimization company India (1)
- PROFESSIONAL SEO COMPANY (1)
- professional SEO service (1)
- ranking master (1)
- robots.txt (1)
- RSS Feed Submission (1)
- Search Engine (17)
- Search Engine Marketing (5)
- Search Engine Marketing India (3)
- Search Engine Optimization (32)
- Search Engine Optimization (SEO) (15)
- Search Engine Optimization India (2)
- Search Engine Optimization Method (1)
- Search Engine Optimization Services India (1)
- Search Engine Optimization Strategies (1)
- search engines optimization (1)
- sem (26)
- sem ahmedabad (38)
- sem india (30)
- SEM Process (1)
- seo (44)
- seo ahmedabad (26)
- SEO AHMEDBABD (1)
- seo articles (27)
- seo Blogging (5)
- SEO Company (3)
- SEO Company in India (2)
- SEO Expert India (8)
- seo gujarat (7)
- seo india (63)
- seo krunal (12)
- seo news (49)
- SEO Optimization (2)
- SEO Outsourcing - India (1)
- Seo Process (1)
- SEO Service India (5)
- Seo services Ahmedabad (5)
- seo services gujarat (2)
- Seo services india (11)
- Seo Success (1)
- seo tips (2)
- seo training (1)
- serch engine marketing (1)
- serch engine optimization (7)
- Sitemaps (2)
- SMO (1)
- SMO INDIA (1)
- Social Bookmarking (3)
- Social Bookmarking SEO (2)
- Social Media Optimization (4)
- Social Network Sites (1)
- Successful Link Building (1)
- top sem india (1)
- top sem seo (32)
- top sem seo india (33)
- top semseo (4)
- top seo (26)
- top seo india (49)
- top seo news (7)
- top seo sem (20)
- top seo sem indai (1)
- top seo sem india (30)
- Top SEO Service (2)
- top seo services (3)
- top seo tips (1)
- tops technologies (1)
- topsemseo (4)
- Web Application Development (1)
- Web Application Development India (1)
- Web design (1)
- Web Design And Development (4)
- web design and development company india (1)
- web design company india (6)
- web design services india (2)
- Web Design Training Ahmedabad (1)
- Web Designing Company in Ahmedabad (1)
- Web Designing Courses (1)
- Web Designing Services (2)
- Web Designing Services india (2)
- web developers India (1)
- Web Development Company (4)
- Web Development India (4)
- web traffic (2)
- Website Designing in India (2)
- Website In Top 10 (1)
- Website Ranking (1)
- Window Application Developer (1)
- Window Application Development (1)
- WordPress Blog (1)
- Yahoo (5)