mysql, ror, future web, optimization, scalability, cloud computing, web 3.0

Mumbai Zone Network ‘Slowness’ Issues since 10:00 AM 22 July 2010

There has been some degradation in network performance in our Mumbai Zone, all sites in Mumbai zone are affected right now, the yo-yo alerts from services like pingdom are pointing to some International routes having issues. The ETA provided by the ISP is another 2 hours while they investigate and fix the issues.

Update 11:05 AM: Our ISP has re-routed some paths to not traverse Bharti-Airtel backbone within and outside the country and things are back to normal for E2E Networks Mumbai Zone network for now.
The ISP’s operations would be back to normal by 3:30 PM or so.

Update 1:55 PM: The ISP has updated all operations are back to normal, their upstream Bharti had a media issue which was causing packet losses but not enough for BGP to do an automatic route re-announcement for our prefixes. The upstream has fixed the issue and the ISP operations are running at optimal capacity and performance as of 1 hour back.

Planned Network Maintenance Delhi Zone: 17 Jul 2010

Emergency Planned Network Maintenance at Delhi Zone has been scheduled tomorrow 17 Jul 2010 between 7:00 AM to 8:00 AM window. Downtime can be expected during this time.

Please email us at support@e2enetworks.com if you have any questions regarding the same.

Update:-
The above Maintenance was scheduled by our Delhi Zone ISP and not by us, we decided to clarify that as our customers hold us to higher standards, and we were informed a mere 9 hours in advance via an SMS, we strive to provide as much information as is available with us to all our customers.

Network Degradation over 19-20 May 2010 around 11:00 PM to 1:30 AM

E2E Networks Delhi Zone had severe network degradation for more than two hours and intermittent network degradation over the course of the night and early morning.  We are awaiting a root-cause report from our ISP on the same. Shall update this blog post as it happens.

Our network uptime over last 3 months remains over 99.9% despite this outage. We’ll update the blog about the latest we get from the ISP.

Other E2E Zones were not affected by the outage.

Why Latency matters in India?

Loading Image in Internet Explorer

Loading…Frustrated on seeing this? The large visible delays in loading a website are really irritating. In this fast paced world, your web visitors don’t want to wait for long for your website to load. A few major causes of latency are discussed here.

One of the main reason for latency is the physical distance of the datacenter where the site is hosted from your visitors. If you are hosting your website on servers in one geographic location but you are receiving visitors from another geographic location, the latency would be high. The sites hosted in countries like US/UK add up a latency of about 300ms to 400 ms which increases page rendering times by a few seconds. With larger number of page elements higher latency makes for higher page load times regardless of optimizations in the size of images and compression of javascript/css elements.

As an example of the effects of latency lets look at a few data points :-

Ping a website hosted in India ( say pluggd.in ) and another hosted in US (mobikwik.com)

Pinging www.mobikwik.com [67.18.92.243] with 32 bytes of data:

Reply from 67.18.92.243: bytes=32 time=344ms TTL=50

Pinging pluggd.in [180.151.0.203] with 32 bytes of data:

Reply from 180.151.0.203: bytes=32 time=53ms TTL=49

The huge difference in latency times of both the websites is clearly visible.

Firebug is an extension for Mozilla FireFox, and can also be used to analyze your site’s network activity.

The firebugs output for both the websites could be seen at

http://e2enetworks.com/wp-content/uploads/mobi.png

http://e2enetworks.com/wp-content/uploads/pluggdin.png

See the net effect in being able to throw in 470KBytes of data in 12.72 seconds mostly from India compared to being able to throw 171 KB of data at the browser in 13.74 seconds. Hosted in US no matter how much processing power you throw at something you hit a lower bound for each content element being pulled in 600 ms or more.

The firebug output for a nearly pure everything in India kind of site can be seen here

http://e2enetworks.com/wp-content/uploads/tarundua.png

There are several hosting companies in India which have their servers in USA and thus sites hosted by these get impacted by high latencies.  How to determine if your site is in USA or India.

Low latency means faster browsing experience and that’s what every end user wants but also higher page views and greater engagement as shown by Google’s study.

Security issues in shared hosting environment

In a Shared Hosting environment, different clients share the whole server but each client has its own set of resources. A number of websites share a single server. It is an economic solution for those websites which do not have high traffic and high storage requirements.

As an online business owner, what is most important for you is the security of your website and here I will discuss the various security issues in shared hosting environment. Let us face the bitter truth that in shared hosting environment, it is not possible to completely cover all the loop holes. A server is never completely secure and everything that interacts with your server is a threat to you.

Let me share an analogy with you. A shared server is like an apartment building and a dedicated server is like having your own house. You are sharing all the resources like water supply, power supply, parking lot etc. with other people in the apartment building. In an apartment building if someone puts on his A.C. then it will put extra load on the power grid of the entire building. If there is short circuit in one apartment, the entire building is prone to face the impact of power cut. Similarly, an anti social element staying next door who tries to peep into your apartment poses a security threat to you. While in your own house, you have all the resources just for yourself which are not shared with anyone. It’s like a dedicated server where the clients have full control over the server regarding the choice of operating systems, root access, hardware, software etc.

In shared web hosting, the HTTP server like Apache requires a control over the files to be served to the client which immediately poses a security concern. If the domains have the ability to run scripts or if the domains have the access to the shell, then in shared hosting environment, one client can modify the files of another client. Though in a multiuser operating system like Linux read/write/execute privileges can be provided to different user groups (user/group/other) yet through a simple PHP script, files outside own home directory can be accessed. Even when using pre-packaged software solutions, you need to allow the hosting server to have read, write and execute access to your files and thus exposing vulnerabilities to other clients. Moreover though the functions like exec( ), shell_exec( ) provide flexibility to the developers, yet they pose adverse security problems. Let us see a very simple example:

Most of the websites require some image uploads from the web and if the client on shared hosting does not have server permission then these uploads will not move to the destination directory. The common solution is to give all the users 777 (read/write/execute) access to the destination directory. This is a common solution but what it has provided is an easy way to hack the files of other users sharing the same server.

Now just think about the situation when your website is on a server that hosts a number of websites out of which few are vulnerable to attacks. Now if even a single one is attacked, the downtime for your website also increases as it is hosted on the same server. And if this happens during working hours when you need to send/receive important emails your business will surely get a negative impact. There are several hosting companies that claim guaranteed 100% uptime which is a complete lie as a server will be down during maintenance. A Denial of Service (DoS) attack on one website impacts the rest of the websites in the shared hosting environment. So a poorly managed server can cause downtime for all sites hosted on the server. Extending the analogy of apartment building, suppose some problem in an apartment on ground floor causes blockage to water, then the water will not climb up to any of the apartments on other floors if there is just a single pipeline. It’s like a DoS in case of shared servers where all the websites suffer.

So concluding, I could say that there is a trade off for low costs in terms of security in shared hosting. Security in shared web hosting cannot be as strong as the dedicated server. So a good solution is to keep your sensitive data in a database. Be careful while uploading files on the server and keep all server utilities up to date. A lot of log tracking, access tracking and website usage tracking have to be done. You even have the option of Virtual Private Servers. VPS or Virtual Dedicated Server (VDS) hosting provides a middle path between shared and dedicated web hosting services. Every user has a full control over his Virtual Server up to his own OS image. This blocks other users from seeing or modifying information even when the information is present on the same server. But if you are playing with highly sensitive data, then the best solution is “Go for a Dedicated or Virtual Private Server(VPS)”