Friday, July 26, 2013

How to download 'weather data' for your analysis?

As I felt difficult to find this URL, I thought this discovery may help someone.

Weather Data set was used as an example to explain the concepts of Hadoop Framework in Tom White's Book (Hadoop: The definitive guide, 3rd Edition)

# get the data from the following URL (till 1st July 2013)


# get the data from the following URL (after 1st July 2013)


And much more data is available at the website for further analysis, some are free - enjoy.

Caution: Loads of data is available there. Please know upfront about what you are downloading. As the data was captured under small files in large number, It takes a lot of time to download. I prefer downloading a year data at a time. (Ex: Year 2007 has around 12000 files).

Note: the below source didn't provide the exact location as the forum thread closed an year ago. Now, this took nearly a day effort for me to locate the URL. Therefore, enjoy the pleasure, you saved the time.

source of infohttp://mail-archives.apache.org/mod_mbox/hadoop-common-user/201202.mbox/%3CC33D2F48-22E6-4F9B-BFEC-0CEB3419E5F6@doddington.net%3E

77 comments:

  1. Thank you soooooo much. I spent a whole day trying to find the data. I would hug you right now, if I could. Again thanks alot.

    ReplyDelete
  2. Thank you so much!
    I had almost given up on this! Cheers!

    ReplyDelete
  3. Thank you so much!
    I had almost given up on this! Cheers!

    ReplyDelete
  4. can you tell me how to extract data from that site

    ReplyDelete
  5. Great post! I am actually getting ready to across this information, It’s very helpful for this blog.Also great with all of the valuable information you have Keep up the good work you are doing well.
    Selenium Training in Chennai | Selenium Training in Bangalore | Selenium Training in Pune

    ReplyDelete
  6. Thanks for one marvelous posting! I enjoyed reading it; you are a great author. I will make sure to bookmark your blog and may come back someday. I want to encourage that you continue your great posts.
    lg mobile service center in porur
    lg mobile service center in vadapalani

    ReplyDelete
  7. Great blog article informative I liked it

    We are the best piping design course in Hyderabad, India. Sanjary academy Offers Piping Design Course and Best Piping Design Training Institute in Hyderabad. Piping Design Institute in India Piping Design Engineering.
    best Piping Design Course
    piping design course with placement
    pipe stress analysis course in hyderabad
    piping engineering course in hyderabad
    piping stress analysis course
    best Piping Design institute
    best institute of Piping Design Course in India
    Piping Design Course
    Piping Design Course in India­

    ReplyDelete
  8. Hey Nice Blog!! Thanks For Sharing!!! Wonderful blog & good post. It is really very helpful to me, waiting for a more new post. Keep Blogging
    BA Revaluation Result 2019

    ReplyDelete
  9. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site. digital marketing training in bangalore

    ReplyDelete

  10. It’s really Nice and Meaningful. It’s really cool Blog. You have really helped lots of people who visit Blog and provide them Useful Information. Thanks for Sharing.citrix training in bangalore

    ReplyDelete
  11. Great post!I am actually getting ready to across this information,i am very happy to this commands.Also great blog here with all of the valuable information you have.Well done,its a great knowledgez. IMSBI Training in Bangalore

    ReplyDelete
  12. Awesome article, it was exceptionally helpful! I simply began in this and I'm becoming more acquainted with it better! Cheers, keep doing awesome
    All University BCOM 1st, 2nd & Final Year Time Table 2020

    ReplyDelete
  13. Its really helpful for the users of this site. I am also searching about these type of sites now a days. So your site really helps me for searching the new and great stuff. Thanks for Sharing This Article.It is very so much valuable content. I hope these Commenting lists will help to my website
    Salesforce Training in Chennai | Certification | Online Course | Salesforce Training in Bangalore | Certification | Online Course | Salesforce Training in Hyderabad | Certification | Online Course | Salesforce Training in Pune | Certification | Online Course | Salesforce Online Training | Salesforce Training

    ReplyDelete
  14. This comment has been removed by the author.

    ReplyDelete
  15. Excellent post. I was always checking this blog, and I’m impressed! Extremely useful info specially the last part, I care for such information a lot. I was exploring this particular info for a long time. Thanks to this blog my exploration has ended.
    If you want Digital Marketing Serives :-
    Digital marketing Service in Delhi
    SMM Services
    PPC Services in Delhi
    Website Design & Development Packages
    SEO Services PackagesLocal SEO services
    E-mail marketing services
    YouTube plans

    ReplyDelete
  16. It’s really Nice and Meaningful. It’s really cool Blog. You have really helped lots of people who visit Blog and provide them Useful Information. Thanks for Sharing.
    salesforce training in chennai

    software testing training in chennai

    robotic process automation rpa training in chennai

    blockchain training in chennai

    devops training in chennai

    ReplyDelete
  17. Nice and very useful blog. A great and very informative post, Keep up the good work!
    DevOps Training in Chennai

    DevOps Course in Chennai


    ReplyDelete
  18. Thanks a lot for sharing kind of information. Your article provide such a great information with good knowledge. Keep posting.

    Java Training in Chennai

    Java Course in Chennai

    ReplyDelete
  19. Hey, Wow all the posts are very informative for the people who visit this site. Good work! We also have a Website. Please feel free to visit our site. Thank you for sharing.
    Be Your Own Boss! If you're looking for a change in your work prospects, then let's prepare for your career from here!!!
    Self Employment | Women Development | Information Technology | Engineering Courses

    ReplyDelete
  20. Hızlı takipçi almak için takipçi satın al
    Organik takipçi almak için takipçi satın al
    Bilgisayardan takipçi almak için takipçi satın al
    Mobil cihazdan takipçi almak için takipçi satın al
    Gerçek ve orijinal takipçi almak için takipçi satın al
    Yazarkasa ile takipçi almak için takipçi satın al
    Bitcoin takipçi almak için takipçi satın al
    Pos ile takipçi almak için takipçi satın al
    EFT ile takipçi almak için takipçi satın al
    Havale ile takipçi almak için takipçi satın al
    Mobil ödeme ile takipçi almak için takipçi satın al
    Tamamı orijinal takipçi almak için takipçi satın al
    Organik ile takipçi almak için takipçi satın al
    Türkiye takipçi almak için takipçi satın al
    Global takipçi almak için takipçi satın al
    En hızlı instagram takipçi satın al
    En uygun instagram takipçi satın al
    En telafili instagram takipçi satın al
    En gerçek spotify takipçi satın al
    En ucuz instagram takipçi satın al
    En otomatik instagram takipçi satın al
    En sistematik tiktok takipçi satın al
    En otantik instagram takipçi satın al
    En opsiyonel instagram takipçi satın al
    En güçlü instagram takipçi satın al
    En kuvvetli instagram takipçi satın al
    En seri instagram takipçi satın al
    En akıcı instagram takipçi satın al
    En akıcı instagram takipçi satın al
    En akıcı instagram takipçi satın al
    En akıcı instagram takip etmeyenler

    ReplyDelete
  21. Here is the best music to calm and relax your mind

    1. best relaxing music
    2. best Depp sleep music
    3. best meditation music
    4. best calm music
    5. best deep focus music

    ReplyDelete
  22. I read this article. I think You put a lot of effort to create this article. I appreciate your work. akatsuki puffer jacket

    ReplyDelete
  23. It is amazing and wonderful to visit your site. Thanks for sharing such a useful information. We are also providing the best services click on below links to visit our website.
    Oracle Fusion HCM Training
    Workday Training
    Okta Training
    Palo Alto Training
    Adobe Analytics Training

    ReplyDelete
  24. What is a shunted vs non shunted tombstone. To understand how to pick ... This is the litmus test of shunted vs non shunted tombstones

    ReplyDelete
  25. It's actually a great and helpful piece of information. I am satisfied that you just shared this useful information for us. BLS Denim Vest

    ReplyDelete
  26. Get that assignment writing service, which students look for these days, from us. Unlike other websites, My Assignment Help is relatively easier and user friendly, when it comes to ordering your assignments. All you have to do is simply fill out the form and sit relax.

    JRRSU Exam Time Table

    ReplyDelete
  27. Wireless LED Lights are designed to increase safety, security and convenience anywhere around the home. Signature features include motion.

    ReplyDelete
  28. Our the purpose is to share the reviews about the latest Jackets,Coats and Vests also share the related Movies,Gaming, Casual,Faux Leather and Leather materials available Ghost Modern Warfare Jacket

    ReplyDelete
  29. A computer desk, often called a led gaming desk or an RGB one due to the lights on them being of colors red-green-blue (RGB).

    ReplyDelete
  30. I love to recommend you Where can crawl Exciting Products latest Jackets, Coats and Vests Click Here Rip Wheeler Jacket

    ReplyDelete
  31. Best software training institute in Chennai. Make your career development the best by learning software courses.

    blueprism training Chennai
    power bi training in chennai
    rpa training in chennai

    ReplyDelete
  32. ecommerce web development company
    ecommerce website development services

    ReplyDelete
  33. Both soft white vs daylight can be called various things. Another way to put it, would be warm vs cool. Or even yet another way, 2700K vs 6000K.

    ReplyDelete
  34. Your article is such an informative article. It is glad to read such those articles thanks for sharing. Coco Miguel Hoodie

    ReplyDelete
  35. Awesome article, it was exceptionally helpful! I simply began in this and I'm becoming more acquainted with it better! Cheers, keep doing awesome!

    OU Degree 1st Sem Result 2021
    PDUSU BSC 2nd Year Result 2021

    ReplyDelete
  36. BIIT(Brahmanand Institute of Information and Technology) is the great Best Digital marketing institute in Laxmi Nagar , which prepares you to emerge as the part of the booming enterprise with the style of wonderful computer guides in Delhi in several streams like Information Technology, Hardware and Networking, Animation & Multimedia, Software development, Website designing & improvement, E-Accounting, and so on. IICS has received the repute of the fine pc schooling institute that trains you with the fine and modern Technologies.
    We have a group of fantastically skilled walking shoes for laptop schooling in Delhi at our pc training centers which can be specialists in the discipline of offering nice training in the diverse streams.


    ReplyDelete
  37. Gemini Promo Code Get Gemini Promo code $50 Bonus when you signup Gemini and Trade $500+ in three days then you received $50 bonus from gemini.Also You can Get $10 Signup Bonus at gemini when you Create account and buy sell $100 crypto in 30 days and Earn $10 bonus instantly.

    ReplyDelete
  38. This comment has been removed by the author.

    ReplyDelete
  39. Thanks for sharing. This blog post was really amazing!
    visit: -swhizz
    Our services:-
    Devops
    aws
    java
    SoftwareTesting

    ReplyDelete
  40. Thanks for sharing this premium article free of cost i really like your article . you can also. shop here

    ReplyDelete
  41. You have lots of great content that is helpful to gain more knowledge. https://liltjaymerch.net/

    ReplyDelete
  42. Have you ever heard about top assignment writers and how they have been helping many students get over their academic burdens?

    ReplyDelete
  43. https://lilpeepmerchandise.com/You have lots of great content that is helpful to gain more knowledge

    ReplyDelete
  44. charlidameliomerch.shopYou have lots of great content that is helpful to gain more knowledge

    ReplyDelete
  45. This is a great inspiring article.I am pretty much pleased with your good work. You put really very helpful information. Keep it up. Keep blogging. Looking to reading your next post.제천출장샵추천
    천안출장샵추천
    공주출장샵추천
    보령출장샵추천
    아산출장샵추천
    서산출장샵추천
    논산출장샵추천
    계룡출장샵추천

    ReplyDelete
  46. kanyewestmerch.shop.This is a great inspiring article.I am pretty much pleased with your good work

    ReplyDelete
  47. Assume for the moment that you are proactive in your search for an assistant who can do excellent work at fair prices and on schedule. If you're looking for a service like "pay someone to do my online class," Pick My Online Class offers it, then you've come to the right place.

    ReplyDelete