36 users online (0 members and 36 guests)  


Page 1 of 2 1 2 Last
  Results 1 to 15 of 16

Related

  1. how to make search engine like yahoo..?    Forum: HTML Forum
    Replies: 12
  2. How to make a search engine?    Forum: HTML Forum
    Replies: 16
  1. #1
    pcdirector's Avatar
    New User

    Status
    Offline
    Join Date
    Jul 2008
    Posts
    1

    How to make seach engine spider craw all pages

    I would like to make sure search engine spider craw all pages of my website .

    Do I have to add meta tags on all pages ? What is the best technic to use mata tags ? Please Help and Thank you !!!

  2. #2
    traffic11's Avatar
    New User

    Status
    Offline
    Join Date
    Jul 2008
    Location
    Argentina
    Posts
    12

    Re: How to make seach engine spider craw all pages

    Quote Originally Posted by pcdirector View Post
    I would like to make sure search engine spider craw all pages of my website .

    Do I have to add meta tags on all pages ? What is the best technic to use mata tags ? Please Help and Thank you !!!
    Hi,
    you should make a file sitemap.xml with all the pages you want to be indexed, and submit it to your Google Account (if you used any of Google free or paid services, you already have one). Go to webmaster tools, inscribe your site (and verify it easily), and in the "sitemap" tab, choose submit sitemap.
    Google's help in their webmaster tools, will guide you to make your sitemap.xml also.

  3. #3
    business-mentor's Avatar
    New User

    Status
    Offline
    Join Date
    Sep 2008
    Posts
    2

    Thumbs up Re: How to make seach engine spider craw all pages

    And you can even use Google Analytics to track your websites statistics.

  4. #4
    Bmaxx's Avatar
    New User

    Status
    Offline
    Join Date
    Sep 2008
    Location
    Jacksonville
    Posts
    1

    Talking Re: How to make seach engine spider craw all pages

    Hello,
    You should visit www.xml-sitemaps.com, it's a free service that will create a sitemap for you to submit to google. After you create sitemap you should upload the file to your server named sitemap.xml to view the sitemap

    I hope this helps

  5. #5
    lovekissing's Avatar
    New User

    Status
    Offline
    Join Date
    Sep 2008
    Posts
    11

    Re: How to make seach engine spider craw all pages

    spread links about your site so that it will be indexed and spiders will know that there is a new born site in her web...

  6. #6
    VIP's Avatar
    New User

    Status
    Offline
    Join Date
    Aug 2008
    Posts
    21

    Re: How to make seach engine spider craw all pages

    The thing is that the vast majority of sites listed in Google results aren't manually submitted for inclusion, but found and added automatically when their spiders crawl the web.

  7. #7
    alex_michael's Avatar
    New User

    Status
    Offline
    Join Date
    Sep 2008
    Posts
    16

    Re: How to make seach engine spider craw all pages

    thank you for your answers

  8. #8
    alex_michael's Avatar
    New User

    Status
    Offline
    Join Date
    Sep 2008
    Posts
    16

    Re: How to make seach engine spider craw all pages

    thanks

  9. #9
    lovekissing's Avatar
    New User

    Status
    Offline
    Join Date
    Sep 2008
    Posts
    11

    Re: How to make seach engine spider craw all pages

    you make use of robot files and consider submitting a sitemap for your site...

  10. #10
    alex_michael's Avatar
    New User

    Status
    Offline
    Join Date
    Sep 2008
    Posts
    16

    Re: How to make seach engine spider craw all pages

    thanks for this but the datalife cms has a sitemap generator. if we get it will have a sitemap.xml for all posts but i want to have a sitemap for a post not all posts!
    what do i do about that?

  11. #11
    HTML's Avatar
    Administrator

    Status
    Offline
    Join Date
    Aug 2000
    Posts
    3,445

    Follow HTML On Twitter Add HTML on Facebook Add HTML on Google+ Add HTML on Linkedin Visit HTML's Youtube Channel

    Question Re: How to make seach engine spider craw all pages

    Quote Originally Posted by alex_michael View Post
    thanks for this but the datalife cms has a sitemap generator. if we get it will have a sitemap.xml for all posts but i want to have a sitemap for a post not all posts!
    what do i do about that?


    That is called a link.
    AHFBWEB Less customers per server, more power for you!

    Business Class Shared Hosting

  12. #12
    Bounties's Avatar
    New User

    Status
    Offline
    Join Date
    Oct 2008
    Location
    Cooranbong NSW
    Posts
    4

    Re: How to make seach engine spider craw all pages

    Hi
    I would still use the xml site map generator and when you download it. Edit out what you don't want. Or use the meta tag for the spiders not to follow if that will help?

    Have a look at the source code of other websites, may help.

  13. #13
    ericajoieake1's Avatar
    Disabled

    Status
    Offline
    Join Date
    May 2009
    Posts
    10

    Re: How to make seach engine spider craw all pages

    most of the seo created a sitemap to be able to crawl all of the pages of their website but if you want your pages to also gain pr, you need to build backlinks with related and high pr sites using the link of your pages.

  14. #14
    bluefirefox007's Avatar
    New User

    Status
    Offline
    Join Date
    May 2009
    Posts
    18

    Re: How to make seach engine spider craw all pages

    You can build links to already index sites. By using SEO tools or manually put the url cache:yoursite.com

    Usually crawled sites or index sites are being crawled again by SE spiders or bot. So If I where you link build for it.

  15. #15
    BlackEyes's Avatar
    New User

    Status
    Offline
    Join Date
    Feb 2009
    Posts
    21

    Re: How to make seach engine spider craw all pages

    If you want search engine spider crawl all of your pages apply on-page optimization in it, make all the pages of your website SE friendly..You can also submit your sub pages to directories and social bookmarking..



Page 1 of 2 1 2 Last

Tags for this Thread