Tuesday, January 26, 2016

RSS reader in c#

 

What is RSS?

RSS (Rich Site Summary) is a format for delivering regularly changing web content. Many news-related sites, weblogs and other online publishers syndicate their content as an RSS Feed to whoever wants it.

Recently I got a requirement of reading rss feeds of blogger and other few sites and load posts in to db.

I followed the following steps.

1. Create Domain Classes

public class Post:Entity
  {
      public Post()
      {
      }

      public Post(long id)
      {
          Id = id;
      }
      public DateTime DatePublished { get; set; }
      public Blogger Blogger { get; set; }
      public string PostGUID { get; set; }
      public string Title { get; set; }
      public string PostURL { get; set; }
      public string Description { get; set; }
      public string ThumbnailURL { get; set; }
      public string PostCategories { get; set; }
      public decimal RankGiven { get; set; }

      public int  RecordCount { get; set; }

  }

2. Create Console App

A console app will first read all the blogger urls in the db then pass it to the rss feed parser.

Following is the code I used to read the RSS feed and load the content in to the Post class which I have defined previously.

    public class RSSFeedParser
       {

           public static List<Post> Parse(List<Blogger> bloggerList)
           {
               List<Post> posts = new List<Post>();
               foreach (Blogger blogger in bloggerList)
               {
                 
                   if (!string.IsNullOrEmpty(blogger.RSSFeedURL))
                   {
                       Console.WriteLine(string.Format("Started reading feeds for : {0}", blogger.BlogURL));
                       try
                       {
                           var rssFeed = XDocument.Load(blogger.RSSFeedURL);
                           XNamespace media = XNamespace.Get("http://search.yahoo.com/mrss/");
                           foreach (var item in rssFeed.Descendants("item"))
                           {
                               var elements = item.Elements();
                               Post post = new Post();
                               post.Blogger = blogger;
                               post.Title = item.Element("title").Value;
                               post.Description = GetTruncakedDescription(item.Element("description").Value);
                               post.DatePublished = Convert.ToDateTime(item.Element("pubDate").Value);
                               post.PostGUID = item.Element("guid").Value;
                               post.PostURL = item.Element("link").Value;
                               post.ThumbnailURL = item.Element(media + "thumbnail") != null ? item.Element(media + "thumbnail").Attribute("url").Value : null;
                               post.PostCategories = string.Join(",", item.Elements("category").Select(x => x.Value).ToList());
                               posts.Add(post);
                           }

                           Console.WriteLine(string.Format("Successfully parsed posts for  : {0}", blogger.BlogURL));
                       }

                       catch (Exception ex)
                       {
                           Console.WriteLine(string.Format("Error occured while parsing posts for  : {0}", blogger.BlogURL));
                       }
                   }
               }

               return posts;

           }

           private static string GetTruncakedDescription(string description)
           {
               string plainTextDesciption = Regex.Replace(description, @"<[^>]*(>|$)|&nbsp;|&zwnj;|&raquo;|&laquo;", string.Empty).Trim();
               string trucatedDescription = plainTextDesciption.Substring(0, plainTextDesciption.Length>400?400 : plainTextDesciption.Length);
               return trucatedDescription;
           }
       }

RSS feed is an XML document with set of defined nodes. You can see the full list of nodes which RSS standard has defined in the following site.

https://validator.w3.org/feed/docs/rss2.html

Here I have read the post name, url, thumbnail, categories and some relevant data I need for my app.

I have used a different method to parse the description field. It is to solve two issues.

1. Description field contains full post content which it too long. So I sub string the content get got the content length as required for my site requirement

2. In some RSS feeds description field contains the HTML file content. But I need to have the plain text. So I used regex to remove html tags from the field content to get the plain text.

Hope this helps.

Happy Coding

Thursday, December 31, 2015

Integrate your GIT repository with Visual Studio 2015

 

You can now easily use visual studio with your solution in GIT. You can Commi, pull, push ans run all source control commands with in your favourite IDE visual studio. You dont need to use any third party tools for that. Integration in so much easy just new steps.

1. Visual Studio-> Team-> Manage Connections

2. Then you can see team explorer

image

3. Under Local GIT repositories Click on clone

image

in there on first text box enter your GIT repository URL and the the second one add the local path and then click clone then It will promted to enter your credentails/

It will download the source code from GIT with source control binding. After that you can see all source control commands related GIT available in your visual studio.

I .Commit your changes locally

after you done with the changes when you right click on a file , project or solution you can find the Commit option as follows. This will commit your changes to local repository.

image

II .Sync your code with server code

Before pushing your code to online GIt repositor you need sync your local repository with server. For that you can use the option sync then pull.

image

III .push your changes to server

Then you can push your changes to server using push option

If you are someone familiar with TFS this is very smiliar to use.Even command names are bit different it does almst the same function

Get rid of usafe tag on angular url

 

Issue :

I recently wanted to use html sms tag in my mobile web site. In the site I have used angual binding to dynamically bind the sms url as follows

<a id="lnk_sms" href="{{sms_Link}}"  class="sms-button social-media-button" alt="SMS" style="display:none">SMS</a>
 
href value is something like :- 'sms:?body=bodyText’

when I run the application agular keep adding a unsafe prefix infront of the url and sms functionality wasn’t working.

<a id="lnk_sms" href="'unsafe:sms:?body=bodyText’"  class="sms-button social-media-button" alt="SMS" style="display:none">SMS</a>

After spending hours I was able to find the problem and soltion

Problem :

Only http, https, ftp and mailto are enabled by default. Angular will prefix a non-whitelisted URL with unsafe:

Solution :

You need to explicitly add URL protocols to Angular's whitelist using a regular expression. A good place to whitelist the sms: protocol would be in your module's config block:

var app = angular.module( 'myApp', [] )
.config( [
    '$compileProvider',
    function( $compileProvider )
    {   
        $compileProvider.aHrefSanitizationWhitelist(/^\s*(https?|ftp|mailto|chrome-extension):/);
        // Angular before v1.2 uses $compileProvider.urlSanitizationWhitelist(...)
    }
]);

The same procedure also applies when you need to use protocols such as file: and tel:.

Please see the AngularJS $compileProvider API documentation for more info.

Hope this Helps!!!

Monday, December 28, 2015

Share you link in Social Media

Technorati Tags: ,

If you want to a share a link in you web app there are plenty of options available.

Recently I got a requirement to share a link , which is browsed through mobile. We have provided the following options to the users.

1. SMS

2. Twitter

3. LinkedIn

4. FaceBook

5. Viber

Following points gives you how to add the functionality to your site easily.

 

1. SMS

For this you have to just put the following HTML tag in to you application which is accessed via mobile. This will open the sms app in user’s mobile pre populated with the content which you have stated.

<a href="sms:/* phone number here */?body=/* body text here */">Link</a>

If you want it to work on iOS, you need this:

<a href="sms:/* phone number here */;body=/* body text here */">Link</a>

Apparently iOS8 had to go and change things on us, so thanks to some of the other commenters/responders, there's a new style for iOS:

<a href="sms:/* phone number here */&body=/* body text here */">Link</a>

(phone number is optional)

You can see a live demo here http://bradorego.com/test/sms.html (note the "Phone and ?body" and "Phone and ;body" should autofill both the to: field and the body text. View the source for more info)

 

2. Twitter

Twitter is really easy. All what you have to do is go to following link and twitter will generate the code to be pasted in you app.

https://about.twitter.com/resources/buttons#tweet

image

You will get something like this finally. Here I am sharing the current page URL.

<a href="https://twitter.com/share" class="twitter-share-button"{count}>Tweet</a>
<script>!function(d,s,id){var js,fjs=d.getElementsByTagName(s)[0],p=/^http:/.test(d.location)?'http':'https';if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src=p+'://platform.twitter.com/widgets.js';fjs.parentNode.insertBefore(js,fjs);}}(document, 'script', 'twitter-wjs');</script>

Rather sharing a link this page gives you generating code for buttons for follow,hashtag and mention.

 

3. LinkedIn

LinkedIn also provides you a button generation in the following link.

https://developer.linkedin.com/plugins/share

image

Here URL is optional. If you keep it blank and generate the button it will be default to current page, In case if you want to share a different URL then you can set it in the URL text box and generate the button. They have different options of buttons with number of shares as well.

finally you will get a code as follows.

<script src="//platform.linkedin.com/in.js" type="text/javascript"> lang: en_US</script>
<script type="IN/Share" data-counter="right"></script>

 

4. FaceBook

Following link provided you step by step on how to add a share button for facebook

https://developers.facebook.com/docs/plugins/share-button#configurator

image

same as the above once this also have a button generator where you just have to copy and paste it.

5. Viber

Viber provided the following link for you to integrate your web app with there viber app.

https://www.viber.com/en/developers/share_on_viber

Just going through two simple steps you can add share via viber options in you web app.

As you can see adding these functionalities are really easy and takes less time. But these functionality will increase traffic in you web app.

Hope this is helpful

Thursday, September 10, 2015

Explicitly freeing memory in c#

Recently I wrote a program which loads some CSV files in to DataTables and do some processing. These files are in large size and have nearly 1 million rows. When I load first file in to data table it works fine. But then I load the second file I get a “Out of Memory exception” even though first I make the previously loaded datatable to null. After searching for hours I found the following solution which solved my issue.

  1. var sourceDataTable = DataParserHelper.GetDataTableFromCsv(@"F:\FileSplitter\Data\5263\property_finance.csv");
  2.         
  3.          sourceDataTable.Clear();
  4.          sourceDataTable.Dispose();
  5.          sourceDataTable = null;            
  6.          GC.Collect();
  7.          GC.WaitForFullGCComplete();
  8.          GC.WaitForPendingFinalizers();

 

if you make the datatable null what happens is it frees the Datatable from the rows and columns. But actually those rows and columns retained in the memory and those are not ready for the garbage collector. But when you call Clear() all the memory will be cleared.

 

Hope this helps.

 

Happy Coding !!!

Monday, September 7, 2015

Sending Emails using SendGrid in C#.net

SendGrid has been built from the ground up as an API company. It is built to serve developers and make it easy to send email no matter your environment. You can send email over SMTP or HTTP, and even use one of it’s official client libraries. In just a few minutes, you can send your first email and millions more. It has different pricing plans for you , so you can select as you want. There is a free plan to which you can send up to 12,000 emails per month for free.

For more details about pricing visit here

1. Create an account in SendGrid

2. Create a Console Application and add the following nuget package.

SendGrid 5.1.0

3. Create a email template in SendGrid.

4. In the following example I’m loading some user information saved in a CSV file and then send password information for those users. Following is the template I have created for that in SendGrid. In the template I have used “{{}}” to specify the tags. You can use what ever the tab you want but make sure you use the same tag when you send the email request to sendgrid

Email Template
  1. <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
  2. "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
  3. <html xmlns="http://www.w3.org/1999/xhtml">
  4. <head>
  5. </head>
  6. <body>
  7. <p>&lt;%body%&gt;</p>
  8.  
  9. <p>Dear {{FirstName}}</p>
  10.  
  11. <p>You have been granted access to  raise online Facilities Service Requests.</p>
  12.  
  13. <p>Your user id is : {{UserName}}</p>
  14.  
  15. <p>Your password is:&nbsp; {{Password}}</p>
  16.  
  17. <p>Thanks</p>
  18.  
  19. </body>
  20. </html>
  21. <title></title>

5. Create a User Model class

  1. public class User
  2.     {
  3.         public string UserName { get; set; }
  4.         public string Password { get; set; }
  5.         public string FirstName { get; set; }
  6.         public string LastName { get; set; }
  7.         public string Email { get; set; }
  8.     }

6. Load CSV file to DataTable

  1. public static System.Data.DataTable LoadContent(string filePath)
  2.       {
  3.           StreamReader sr = new StreamReader(filePath);
  4.           string[] headers = sr.ReadLine().Split(',');
  5.           DataTable dt = new DataTable();
  6.           foreach (string header in headers)
  7.           {
  8.               dt.Columns.Add(header);
  9.           }
  10.           while (!sr.EndOfStream)
  11.           {
  12.               string[] rows = sr.ReadLine().Split(',');
  13.               DataRow dr = dt.NewRow();
  14.               for (int i = 0; i < headers.Length; i++)
  15.               {
  16.                   dr[i] = rows[i];
  17.               }
  18.               dt.Rows.Add(dr);
  19.           }
  20.           return dt;
  21.       }

7. Load User List using the DataTable

  1.  public static List<User> GetUserList(DataTable content)
  2.       {
  3.           List<User> users = new List<User>();
  4.  
  5.             foreach (DataRowrow in content.Rows)
  6.           {
  7.               User user = new User();
  8.               user.FirstName = row["FirstName"].ToString();
  9.               user.LastName = row["LastName"].ToString();
  10.               user.UserName = row["UserName"].ToString();
  11.               user.Password = row["Password"].ToString();
  12.               user.Email = row["Email"].ToString();
  13.               users.Add(user);
  14.           }
  15.  
  16.           return users;
  17.       }

8. Send Email to users using SendGrid

  1. public static void SendEmail(string filePath)
  2.       {
  3.           DataTable content = LoadContent(filePath);
  4.  
  5.           List<User> users = GetUserList(content);
  6.  
  7.           foreach (User user in users)
  8.           {
  9.               string xmstpapiJson = GetMessageHeader(user);
  10.  
  11.               SendGridMessage sendGridMessage = new SendGridMessage();
  12.               sendGridMessage.From = new MailAddress(fromAddress, fromName);
  13.               sendGridMessage.AddTo(user.Email);
  14.               sendGridMessage.Subject = "New Registration";
  15.               sendGridMessage.Headers.Add("X-SMTPAPI", xmstpapiJson);
  16.               sendGridMessage.Html = string.Format(" ");
  17.  
  18.  
  19.               var userName = sendGridUserName;
  20.               var password = SendGridPassword;
  21.               var credentials = new NetworkCredential(userName, password);
  22.               var transportWeb = new Web(credentials);
  23.  
  24.               transportWeb.Deliver(sendGridMessage);
  25.               Console.WriteLine("Email Sent to:"+user.Email);
  26.            
  27.               
  28.           }
  29.  
  30.           Console.WriteLine(string.Format("{0} Emails Sent", users.Count()));
  31.           Console.ReadLine();
  32.           
  33.       }
  34.  
  35.       private static string GetMessageHeader(User user)
  36.       {
  37.           var header = new Header();
  38.  
  39.           header.AddSubstitution("{{FirstName}}", new List<string> { user.FirstName });
  40.           header.AddSubstitution("{{LastName}}", new List<string> { user.LastName });
  41.           header.AddSubstitution("{{UserName}}", new List<string> { user.UserName });
  42.           header.AddSubstitution("{{Password}}", new List<string> { user.Password });
  43.           header.AddFilterSetting("templates", new List<string> { "enabled" }, "1");
  44.           header.AddFilterSetting("templates", new List<string> { "template_id" }, "67d23037-08bc-445a-bda1-903f6af65b67");
  45.           return header.JsonString();
  46.       }

 

Hope This Helps.

 

Happy Coding !!!

Point in Time Restore in Azure SQL Database

With new Basic, Standard and Premium Service Tiers , you get the new improved facility of “Point in Time Restore”. Which is, it provides you zero-cost automatic backup system. You only incur additional cost if you use the restore capability. The new database created by restore is charged at normal database rates. Together, the automated backup system and point-in-time restore provide a zero-cost, zero-admin way to protect databases from accidental corruption or deletion, whatever the cause.

Period that backups retain will based on the service tier.

Basic Tier :- 7 Days

Standard Tier :- 14 Days

Premium Tier :- 35 Days

 

Restoring a Live Database to a Point in Time

Using Azure management portal you can easily. Go to the Database which you want to restore. Then Click on the “Restore” Button in the bottom bar.

image

You will be prompted for a new database name and offered a slider control to pick the restore point within the retention period. Alternatively, you can manually enter the date and time to the nearest minute. Once you confirm the action, the database will be restored.

image

 

After you confirmed your new database will be create in with the given name in the same database sever.The time taken to restore the database depends on many factors, including the size of the database, the time point selected, and the amount of activity that needs to be replayed to reconstruct the state at the selected point. For a very large and/or active database restore may take several hours.

 

Restoring a Deleted Database

If you want to restore a deleted database which is using Basic, Standard or Premium service tier , You are given the facility of restoring it to the point which it has been deleted. To restore go to SQL databases tab in Management portal and go to deleted databases. There you can see a list of databases which has been deleted.

image

Select the database you want to restore then click on the restore button at the bottom. Then you will get the following window which you can type a name for the database and restore the backup for a new database

image

 

Hope this helps.