Welcome!

Open Source Cloud Authors: Stackify Blog, Vaibhaw Pandey, Automic Blog, John Walsh, Mehdi Daoudi

Related Topics: Open Source Cloud

Open Source Cloud: Article

.NET Programming with Open Source Databases

Creating .NET applications using MySQL and PostgreSQL

In the past, using open source databases meant running UNIX (or Linux) servers and open source development environments. Today however, the two most popular open source database packages - MySQL and PostgreSQL - have full featured Windows installations, and can be run on most Windows platforms. This allows Windows developers to easily utilize open source databases in their applications.

To make life even easier, both MySQL and PostgreSQL provide .NET Data Provider classes that can be used in your .NET programs to easily access the database servers, send queries, and retrieve query results. This article walks you through creating .NET applications using both the MySQL and PostgreSQL open source databases.

MySQL
The MySQL open source database software is quite possibly the most popular open source database system available. While relatively new to the Windows world, it is a popular back end database used in Web-based applications running on UNIX and Linux systems.

The MySQL Windows installation package can be downloaded for free from the MySQL Web site (www.mysql.org). Make sure to download the Windows binary installation package, and not one of the ones for the various UNIX and Linux flavors. At the time of this writing, the most current MySQL Windows installation package was mysql-essential-5.0.24a-win32.msi. This file contains the complete MySQL server, as well as a few extra client programs. Download the file to a temporary directory on your Windows system.

After downloading the installation package, you can start the installation process. A standard installation wizard guides you through the simple installation process. The typical package installs both the MySQL server software and a couple of MySQL client applications that come in handy for administering and using the MySQL server - the command line interface and the server configuration utility. At the end of the installation, you have the option to immediately configure the MySQL server using the server configuration utility.

The MySQL server configuration utility involves setting up the MySQL server instance to handle the anticipated database applications that will run on the server. You can choose from a detailed configuration process or a simplified configuration process. The simplified configuration process sets the server configuration parameters - such as memory usage and allowed concurrent connections - using standard default values. If you want to fine-tune the server performance, you can choose the detailed configuration option and manually set the performance values. You can also use the server configuration utility after the initial server installation to change parameters on the server configuration. The server configuration utility is shown in Figure 1.

During the configuration process you can opt to automatically start the MySQL server as a Windows service. This allows the MySQL server to run as a background process on the Windows system without any user intervention.

Once the MySQL server service is running, you can test the installation by connecting with the command line client. Start the MySQL command line client application by clicking Start, All Programs, MySQL, MySQL Server 5.0, MySQL Command Line Client. A command prompt window appears, and asks for the MySQL root user password (this was set during the configuration process). After entering the root password, a command prompt appears.

At the command prompt, you can enter simple SQL commands to interact with the database. There are also several special meta-commands that are used for displaying server and database information. Use the \s command to retrieve the status of the running server:

mysql> \s
--------------
C:\Program Files\MySQL\MySQL Server 5.0\bin\mysql.exe Ver 14.12 Distrib
5.0.24a, for Win32 (ia32)

Connection id:      3
Current database:
Current user:        [email protected]
SSL:                    Not in use
Using delimiter:      ;
Server version:      5.0.24a-community-nt
Protocol version:   10
Connection:           localhost via TCP/IP
Server characterset:     latin1
Db characterset:          latin1
Client characterset:      latin1
Conn. characterset:     latin1
TCP port:      3306
Uptime:      9 min 29 sec

Threads: 1 Questions: 15 Slow queries: 0 Opens: 12 Flush tables: 1
Open tables: 6 Queries per second avg: 0.026

--------------

mysql>

This \s met-command shows that the MySQL server is running, the version that is running, and a few other server statistics.

MySQL Connector/NET
Now that you have a running MySQL database server, you can start developing .NET programs that interact with it. This is done using the MySQL Connector/NET software.

This package provides the .NET classes required to connect to a MySQL database server, log in using a user account, and access tables and other database objects. You can download the MySQL Connector/NET package from the site:

dev.mysql.com/downloads/connector/net/1.0.html

The package is downloaded as a ZIP file that contains the Windows .msi installation program. You must extract the installation package from the ZIP file to run it. After starting the Connector/NET installation, you can select between several options for installing just the core library files, the documentation, sample programs, and the complete library source code. The installation options window is shown in Figure 2.

You at least need to install the Core Components to run MySQL .NET applications. If you want to have the Connector/NET class documentation handy, it is also a good idea to install the documentation option as well.

At the end of the installation, you have the option to load the Connector/NET classes into the .NET Global Assembly Cache. This allows any .NET application on the system to access the Connector/NET classes. By default, the installation creates three folders: one for the .NET 1.0 connector library file, one for the .NET 1.1 connector library file, and one for the .NET 2.0 connector library file. Each of the files is called by the same file name (MySql.Data.dll), so you can only install the one that is associated with your .NET installation version.

Using the MySQL Connector/NET classes
The Connector/NET library contains several classes used to interact with the MySQL server. These are shown in Table 1.

The server connection is started using a MySqlConnection object. The constructor includes a connection string, which defines the server, database, and user account information:

MySqlConnection conn = new MySqlConnection("Source=localhost;Database=test;

           User Id=root;Password=testing");

The resulting connection object can then be used in a MySqlCommand object to reference the connection. The MySqlCommand class contains the text SQL command that is sent to the server. The class contains three methods used for executing the SQL command, shown in Table 2.

The ExecuteScalar() and ExecuteNonQuery() methods return a single value from the server. The ExecuteReader() method returns a complete result set, which can be placed into a MySqlDataReader object to extract the individual result set data:

String query = "Select * from employee";
MySqlCommand comm. = new mySqlCommand(query, conn);
conn.Open();
MySqlDataReader data = comm..ExecuteReader();
while (data.Read())
{
     int empid = data.GetInt32(0);
     String lastname = data.GetString(1);
     String firstname = data.GetString(2);
     float salary = data.GetFloat(9);
     Console.WriteLine("{0} - {1},{2} ${3}", empid, lastname, firstname, salary);
}

The SQL command is sent to the MySQL server using the ExecuteReader() method. The return value is a MySqlDataReader object, which contains the result set returned from the server. The Read() method is used to read forward through the result set, one record at a time. The GetString(), GetFloat(), GetDate(), and GetInt32() methods are used to extract the individual column data elements from the retrieved record. Columns are referenced in the order they appear in the table, starting with 0.

Listing 1 shows the getdata.cs program. This program demonstrates the steps required to extract data from a MySQL database table using Connector/NET. Remember you must reference the MySql.Data.dll file when compiling the application:

csc /r:MySql.Data.dll getdata.cs

After compiling the program, you can run it against a test database:

C:\> getdata
100 - Blum, Rich     $20000
101 - Blum, Barbara     $45000

The individual data records are extracted from the result set, and the individual data elements within the records are extracted and displayed.

Using PostgreSQL
The PostgreSQL open source database is known for having the most features of all the open source databases. PostgreSQL can compare head-to-head with most commercial database packages. It can be downloaded for free from the PostgreSQL Web site (www.postgresql.org). Again, make sure to download the Windows binary version.

The PostgreSQL installation wizard guides you through the steps of installing and configuring a basic PostgreSQL server all in one process. The Installation Options window shown in Figure 3 provides an opportunity for you to select the PostgreSQL options to install.

For .NET development, make sure you install the Npgsql option. This is the PostgreSQL .NET connector library that allows you to create .NET applications for PostgreSQL databases.

Using the Npgsql classes
The Npgsql library contains all the classes required to connect to a PostgreSQL server, send an SQL command, and retrieve the result set data. The Npgsql classes are shown in Table 3.

You might see a trend here. Most of the basic Npgsql library classes are similar to the MySQL Connector/NET classes, and they behave in similar ways. This makes it relatively easy for .NET developers to switch code from one open source database server to another.

In Npgsql, the connection is started using the NpgsqlConnection class. The class constructor uses a connection string to define the server and database to connect to:

NpgsqlConnection conn = new NpgsqlConnection("Server=localhost;Database=test;
User Id=postgres;Password=testing");

The resulting NpgsqlConnection object is then used in NpgsqlCommand objects to send SQL commands to the database server. As expected, the NpgsqlCommand class contains the SQL command to send to the server. It also contains three separate methods for sending SQL commands to the server, as shown in Table 4.

If the SQL command sent to the server returns a result set, use the NpgsqlDataReader class to extract the individual data elements from the result set:

NpgsqlCommand comm. = new NpgsqlCommand(query, conn);
NpgsqlDataReader data = comm.ExecuteReader();
while(data.Read())
{
     int empid = data.GetInt32(0);
     String lastname = data.GetString(1);
     String firstname = data.GetString(2);
     Float salary = data.GetFloat(9);
     Console.WriteLine("{0} - {1},{2} ${3}", empid, lastname, firstname, salary);
}

Look familiar? This is the same code format as used for the MySQL Connector/.NET library. For SQL commands that only return a single value (such as functions), you can use the ExecuteScalar() method:

NpgsqlCommand comm. = new NpgsqlCommand("Select pi()", conn);
Double result = (Double)comm.ExecuteScalar();

Again, this is similar to the structure used for the MySQL Connector/NET library.

Summary
The MySQL and PostgreSQL open source databases are excellent resources for .NET developers. Having a database back end available that can be scaled from a simple Windows workstation to a large UNIX server platform can be invaluable for growing applications. Both MySQL and PostgreSQL supply .NET Data Providers that can be used to write .NET code that directly accesses open source databases. Both of the Data Provider packages contain similar classes that are used for connecting to the server, sending queries, and retrieving result sets. With these tools in hand, it is easy to start using open source database servers with your .NET applications.

More Stories By Richard K. Blum

Richard Blum currently works for a large US government organization as a network and systems administrator. He is the author of C# Network Programming (2002, Sybex) and Professional Assembly Language (2005, Wrox).

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things’). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing? IoT is not about the devices, it’s about the data consumed and generated. The devices are tools, mechanisms, conduits. In his session at Internet of Things at Cloud Expo | DXWor...
Everything run by electricity will eventually be connected to the Internet. Get ahead of the Internet of Things revolution. In his session at @ThingsExpo, Akvelon expert and IoT industry leader Sergey Grebnov provided an educational dive into the world of managing your home, workplace and all the devices they contain with the power of machine-based AI and intelligent Bot services for a completely streamlined experience.