Tuesday, April 19, 2016

Natural Language Processing. Brief intro

For the last year,  I'm working with Natural Language Processing (mostly with Deep Learning).  And I've decided to write a set of blog posts with the description of the most trend ideas in the field. So, let's start from the very beginning.

Natural Language Processing is a field at the intersection of computer science, Artificial Intelligence and linguistic. The main goal of NLP is to "understand" natural language in order to perform some useful tasks, like question answering.

Some examples of NLP applications:
  • Spell checking, keyword search, finding synonyms
  • Extracting information from websites such as time, product price, dates, location, people or company names
  • Classifying texts 
  • Texts summarisation
  • Finding similar texts
  • Sentimental analysis 
  • Machine translation
  • Search
  • Spoken dialog systems
  • Complex query answering
  • Speech recognition
Texts could be analyzed on different levels: phonemes, morphemes, words, sub-sentences, sentences, paragraphs and whole documents. 
From linguistic point of view, analysis could be done on these levels:
  • Syntax (what is grammatical)
  • Semantic (what does it mean)
  • Pragmatics(what does it do)
There are a lot of smart algorithms, which were developed for various tasks:

NLP is hard. First of all, because of:
  • ambiguity - more than one possible(precise) interpretation (e.g. "Foreigners are hunting dogs"), 
  • vagueness - does not specify full information
  • uncertainty -  due to imperfect statistical mod

In mid-2010 Neural Nets become successful in NLP.  Why did it happen?
I'll describe the main ideas of deep learning techniques for NLP  in the next post :)




41 comments:

  1. You did a great job, i really like your blog. This will be so helpful. Thanks a lot.

    Data Science Certification

    ReplyDelete
  2. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.
    tail spend management

    ReplyDelete
  3. Thanks for sharing this amazing information with us. Keep posting like this...

    Data Science Classes in Pune

    ReplyDelete
  4. Really appreciate that coming from you ! Thanks for the kind words and the share. We provide Data science online training with 100% job placement.
    Data Science training in Chennai | Data Science Training Institute in Chennai | Data Science Course in Chennai

    ReplyDelete
  5. Superb. I really enjoyed very much with this article here. Really it is an amazing article I had ever read. I hope it will help a lot for all.
    Thank you so much for this amazing posts and please keep update like this excellent article.
    thank you for sharing such a great blog with us. expecting for your.

    python Training in Bangalore | Python Training institute in Bangalore

    ReplyDelete
  6. thanks for this excellent article! Just the scripts I've been looking for. a quick question:
    how did you create those beautiful charts/graph in your post? many thanks!!!Java training in Chennai | Java training institute in Chennai | Java course in Chennai

    ReplyDelete
  7. Thanks for providing usefull article containing valuable information.start learning Workday Online Training | Workday HCM Online Training.

    Workday HCM Online Training

    ReplyDelete
  8. Thanks for sharing such a good article having valuable information.best to learn Big Data and Hadoop Training In Hyderabad.

    Big Data and Hadoop Training In Hyderabad

    ReplyDelete
  9. Thank you for sharing your awesome and valuable article this is the best blog for the students they can also learn.

    Workday HCM Online Training

    ReplyDelete
  10. Great Blog!thanks for giving information it is very intresting to tread and it is very useful which you have provided...
    tableau Training In Hyderabad
    Hadoop Training In Hyderabad

    ReplyDelete
  11. It’s really nice information to share here. Thanks for your blog, keep posting like this regularly. Thank you Data Science Training in Hyderabad

    ReplyDelete
  12. Good Post. I like your blog. Thanks for Sharing like this posts........!
    Data Science Training in Bangalore

    ReplyDelete
  13. Interesting, Thanks for giving great kind of information.It is useful and practical for me. Thanks for your excellent blog, nice work keep it up!!
    Machine Learning Training in Bangalore

    ReplyDelete
  14. Attend The Data Analytics Courses in Bangalore From ExcelR. Practical Data Analytics Courses in Bangalore Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Data Analytics Courses in Bangalore.
    ExcelR Data Analytics Courses in Bangalore

    ReplyDelete
  15. Such a very useful article. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article.
    data science course in guwahati

    ReplyDelete
  16. Great tips and very easy to understand. This will definitely be very useful for me when I get a chance to start my blog. ExcelR Data Science Courses

    ReplyDelete
  17. wow, great, I was wondering how to cure acne naturally. and found your site by google, learned a lot, now i’m a bit clear. I’ve bookmark your site and also add rss. keep us updated.
    best data science courses in hyderabad

    ReplyDelete
  18. wow, great, I was wondering how to cure acne naturally. and found your site by google, learned a lot, now i’m a bit clear. I’ve bookmark your site and also add rss. keep us updated.
    data science course in hyderabad with placements

    ReplyDelete
  19. Really impressed! Everything is very open and very clear clarification of issues. It contains truly facts. Your website is very valuable. Thanks for sharing.
    data scientist course in hyderabad

    ReplyDelete
  20. This information is impressive..I am inspired with your post writing style & how continuously you describe this topic.

    Python Training in Pune
    Python Training Institute in Pune

    ReplyDelete
  21. Ранние приемы ворожбы были образованы за несколько тысяч лет до нашей эры. Гадания онлайн бесплатно самые точные расклады на картах считается наиболее достоверным вариантом прочитать судьбу человека. Природные катаклизмы или обрядовые жертвоприношения основали точное трактование обнаруженного.

    ReplyDelete
  22. Simple wireframes can be turned into appealing UIs. Format widgets can be done with ease using this application. Prototypes are created for the web and desktop Axure RP Pro Full Crack

    ReplyDelete
  23. An activation code is a code you receive when you buy a license for a Kaspersky application. It consists of 20 digits and is divided into Kaspersky Total Security Activation Code

    ReplyDelete