Thursday, 13 June 2013

Outlook 2013 Bug when using IMAP - Beware the Bandwidth Blowout!

We recently had issues with our work internet connection that meant sizeable amounts of data were being chewed up without our users doing anything in particular or untoward.

Using the bandwidth monitor utility Networx (http://www.softperfect.com/products/networx/) (which breaks accumulated traffic down by process), we specifically found that Outlook 2013 was downloading large amounts of data (40-50MB) - many (but not all) times that a "Send and Receive" synch was performed. This was using IMAP running against the open source DoveCot (http://www.dovecot.org/) as a mail server.

Now by default, this is set to every 30 minutes. If a machine is on 24 hours day, this can add up to 2.4GB per user - which clogs up your network and really adds up on anything but an unlimited plan!

Cracking open Wireshark (http://www.wireshark.org/), I turned off SSL to see what was going on in terms of the IMAP commands going down the wire and the full extent of the download. Nothing stuck out apart from the fact that setting the "Mail to keep offline setting" to 24 months as below performs an IMAP "UID SEARCH SINCE 13-Jun-2011" to filter results. This is as expected.


To my surprise, with the default "All" Setting for "Mail to keep offline", you can also see that on regular but apparently random occasions every single email (including ALL content and ALL binaries) was being downloaded every time from the mail server - regardless of whether Outlook already had a locally cached version or not. Sometimes, the download will only be 5MB per click of "Send and Receive All". I tried to reproduce it and it tends to happen when you save Drafts or send/receive large items in your inbox - but I wasn't able to isolate the issue through a process of elimination.

This may well be part of the OST corruption issues mentioned here - the IMAP issues in Outlook 2013 are apparently high on the MS internal support agenda:
http://productforums.google.com/forum/#!topic/gmail/9alMlaOkMC4

In terms of the mail server, the installed version of Dovecot also seems to support LIST-EXTENDED for special folder support introduced in Outlook 2013 - so that doesn't appear to be the problem (unless there is a variation on the standard between Outlook/the IMAP server - which is not impossible).

So no clear conclusions I'm afraid. The one thing that is clear is that there are problems with Outlook 2013 and IMAP - based on the large number of problems I've seen floating around the web. The above problem is just one example of these. I've also seen that Outlook 2013 sometimes doesn't download new emails at all (even though other clients such as Android download from the same mail server correctly.). In addition, when working with drafts and saving the draft email repeatedly, Outlook will not be able to save it and say that it must be saved as a new copy within your Drafts folder.

Apparently, a fix to some of these problems should be released around August 2013 (as per http://productforums.google.com/forum/#!topic/gmail/9alMlaOkMC4)

In the meantime, to fix the heavy bandwidth usage issue, I can only suggest:
  1. Roll back to Outlook 2010 if you're using IMAP . This seems to be a popular option - although you cannot have Outlook 2013 and 2010 running simultaneously (unlike other MS Office Products).  [Recommended - this worked in my situation and reduced synch bandwidth usage from 50MB to 850KB]
  2. Perform a full initial synchronisation with the default "All" setting. Then reduce your "Mail to keep offline" time window to a smaller figure after this initial synchronization (e.g. 1 month) 
  3. Delete your local OST file and set up email again. This may give you temporary relief from the problem - but it wasn't a permanent fix for me.
  4. Use yet another client like Thunderbird - although this apparently also has issues with non-appearing folders with some IMAP providers as well.
  5. Reduce your synchronisation frequency (to something less than 30 minute full synchs). 
  6. Update your mail server if possible to ensure full compliance with standards. This isn't an option for me. You should also confirm this with a pilot/Proof of Concept to confirm that it fixes your specific issue.
  7. Clean out/auto-archive your emails!

DDK

74 comments:

quark said...

Thank you for your suggestions, I'm fighting against this bug since January when my 10 GB/month mobile internet plan was completely swallowed by Outlook 2013.

Thomas in Oz said...

A few clients of ours are struggling with this exact problem, but don't have the option of rolling back to 2010.

Have you discovered a permanent fix since writing this?

tonycorallo said...

Thanks for posting. It has helped my sanity.

I finally looked into my bandwidth issues because I was having to move from unlimited to limited bandwidth and identified Outlook 2013 as the culprit using free or trial versions of Networx and NetBalancer.

I’m an Outlook 2013 home premium subscriber and I have 3 IMAP accounts set up whose data files total about 1.8 GB and a Gmail IMAP (700 MB) and Hotmail ActiveSync (120 MB) accounts. Nothing too unusual I would have though and I didn’t have any bandwidth issues on any of the previous 3 version of Outlook.

I had Outlook set up to send and receive every 2 minutes and it managed to consume 210 to 240 MB per HOUR! Even when there were no emails being received.

I also have no way of rolling back to a previous version so I called Microsoft who said that there is no issue and that I must contact my mail service provider or an issue with another device which checks my email. The guy said that this is the first time that he has ever heard of an issue like.

It’s all very frustrating, particularly as there doesn't appear to be any end in sight.

Unknown said...

This!

This is EXACTLY the issue we're currently experiencing. We've been moving clients from pop to imap based accounts, and our bandwidth usage has skyrocketed. 1 client has about 2gb of mail in their account, about 60mb in their inbox. Watching the mail logs, they were doing 34mb of downloads every 5 minutes.

Just want to clarify, did reducing the offline setting to something less than ALL cause outlook to do a proper sync and only download new messages, or does it just mean it now downloads a subset of messages based on the date, but still downloads every single message regardless of status?

Unknown said...
This comment has been removed by the author.
Unknown said...

Oops previous typo.....

Me too.

I'm chewing through about 5Gb a day. My 25Gb/month Telstra plan isn't holding up well.

Is there a solution yet?

JC

Willie said...

Since you are running Dovecot, I think suggestion #6 is a little silly. Dovecot is just about as standard as you can get when it comes to IMAP.

Wifiuk said...

would be great if someone had an idea how to fix this?

Rick said...

Hah, IT guy here and me and my company have been scratching our heads how one of our clients went from - to over 50gb of data within a few days.

This, we have determined, is the culprit. Now that I've seen these posts i'm sure of it.

Sigh

dom said...

Same issue here - I went back to POP3 a week ago, bandwith issues solved (I had peaks up 15Gb / day on IMAP !!!)

Jonathan said...

We operate mailservers and noticed that IMAP usage on one client account went from 20Mb or so per day to 6.5Gb and now 8Gb per day. We run Dovecot and client has Outlook 2013 so this looks like the issue. Not sure what changed on the day bandwidth shot up. Client was operating Outlook 2013 before and we have not updated Dovecot.

tonycorallo said...

it looks like this issue has been fixed in the latest update - 15.0.4551.1005

Jonathan said...

Hi quartermileburner

Sounds you got some good news for us there. Do you have a reference or Change History link for the latest release 15.0.4551.1005 so we can see the issue has been addressed? I can't find any info on the release.

Thank you.

Anonymous said...

You wrote tha the preblem may be fixed with Outlook version 15.0.4551.1005. Is that really sure. Have you alaysed it?
The huge data amound pisses me off. I would have no problem to change the client if there would be another Exchange active Sync Client for Windows 7.

21cssIndia said...

Online Training
This year’s Technology online training classes for many students in the world look radically different from those in the past. Powered in part by the 21st Century Software Solutions—providing online trainings on all technologies by real time experts.
Online training is a precious and cost-effective method for continuous education and overall efficiency development that provides employees with well-rounded individuals and motivated employees dedicated to building the carrier.

Convenient - As employees struggle to balance the demands of work and home, Online Training allows them to learn from work, home and on the road. Relevant - Since course content includes the most current topics, Online Training ensures training is related to a person's career path. Instant - Delivery over the Internet enables Online Training to begin with just a few mouse clicks. Affordable - Cost savings is a key attraction as corporations save between 50-70% due to elimination of travel expenses according to Training journal. Fun - By providing a charming interactive environment with dynamic content, Online Training not only effectively keeps people up-to-date, but interested as well. Easy to Use - Open an Internet browser and employees are up and running quickly. ROI to the Max - Affordable online training can be up to 93% cheaper than instructor-led courses. Self Directed and suitable - Employees to learn at their own pace and maintain control of learning “where, when and how” with boundless access 24/7by 21st Century Software Solutions. contact@21cssindia.com
http://www.21cssindia.com/courses.html

Doug said...

Fought this problem for 3 days, I went in and increased the server timout period to 4min 20 secs in the Account Settings->More Settings->Advanced slider (nothing magic about that number I just grabbed the slider and moved it way right) and since then Outlook 2013 / IMAP on an Inbox with 7000 mails is flying - no repeat syncing - no huge bandwidth syncs.

Davids in Europe said...

Not sure if this will help, but I just went into Preferences/accounts/advanced/ and ticked 'download headers only' and 'except in inbox'.

Seems to have done the trick. Went from 500+kb/sec to 3kb/sec/

Hope it works for you too :)

Unknown said...

I fixed my problem with Gmail/Outlook 2013 sync by going to Google and managing my account.

There is a spot to turn on "Access for less secure apps." They don't recommend that you do it, but I'm now able to receive my Gmail after setting up a new account in Outlook 2013.

I hope this helps.

Sandman3

Manjit said...

Reducing your "Mail to keep offline" time window to 1 month seems to work

Devi.Angularjs said...

I have read your blog its very attractive and impressive. I like it your blog.

.Net Training in Chennai | .Net Online Training

Dot Net Online Training | LINQ Online Training ASP.NET Online Training

Unknown said...

I love this blog because it is really helpful and informative blog for us and I’m thankful to you for sharing this blog. For any kind of technical support your visit the website Outlook Phone Number UK or call at 0800-090-3220.

Sheela said...

This is a nice article here with some useful tips for those who are not used-to comment that frequently. Thanks for this helpful information I agree with all points you have given to us. I will follow all of them.
Best Devops online Training
Online DevOps Certification Course - Gangboard

tamizh said...

This is an awesome post.Really very informative and creative contents. These concept is a good way to enhance the knowledge.I like it and help me to development very well.Thank you for this brief explanation and very nice information.Well, got a good knowledge.
Selenium training in Chennai
Selenium training in Bangalore
Selenium training in Pune
Selenium Online training

Aliya Manasa said...

This is quite educational arrange. It has famous breeding about what I rarity to vouch. Colossal proverb. This trumpet is a famous tone to nab to troths. Congratulations on a career well achieved. This arrange is synchronous s informative impolite festivity to pity. I appreciated what you ok extremely here.
python Course in Pune
python Course institute in Chennai
python Training institute in Bangalore

Praylin S said...

Awesome post with valid content. Thanks for sharing this with us. Looking forward to learn more from you.
Tally Course in Chennai
Tally Training in Chennai
Embedded System Course Chennai
Embedded Training in Chennai
LINUX Training in Chennai
LINUX Course in Chennai
Tally Course in Tambaram
Tally Course in Velachery

jefrin said...

amazing post thanks for sharing
power BI training course in chennai

service care said...

I am amzaed by the way you have explained things in this post. This post is quite interesting and i am looking forward to read more of your posts.
lenovo service center in chennai
lenovo mobile service center in chennai
lenovo service centre chennai
lenovo service center
lenovo mobile service center near me
lenovo mobile service centre in chennai
lenovo service center in velachery
lenovo service center in porur

Riya Raj said...

Wonderful Blog.... Thanks for sharing with us...
Hadoop Training in Chennai
Big data training in chennai
Big Data Course in Chennai
hadoop training institute in chennai
Big data training in OMR
Hadoop Training in Annanagar
Big data training in chennai
JAVA Training in Chennai
Android Training in Chennai
JAVA Training in Chennai

Unknown said...

I like viewing web sites which comprehend the price of delivering the excellent useful resource Python classes in pune free of charge. I truly adored reading your posting. Thank you!

shwethapriya said...

Really informative blog for all people. Thanks for sharing it.
Spoken English Classes in Chennai
Spoken English in Chennai
Data Analytics Courses in Chennai
IELTS Coaching centre in Chennai
Japanese Language Classes in Chennai
TOEFL Classes in Chennai
Spoken English Classes in Tambaram
Spoken English Classes in Anna Nagar

RoyceRobbie said...

Good information and, keep sharing like this.

Crm Software Development Company in Chennai
web portal development company in chennai
web portal development services in chennai
professional web design company in chennai
smo company in chennai
seo company in chennai
best seo company in chennai
erp software development company in chennai
sem services in chennai
twitter marketing company in chennai

Savanah Eden said...

We help you to get best websites and good ranking in search engines, visit us
Erp software development company in chennai
Professional webdesigning company in chennai
seo company in chennai
Crm software development company in chennai

swathima said...

thanks for your extrodinary services , go ahead
Scaffolding dealers in chennai

Yourdoorstep said...

Thanks for Fantasctic blog and its to much informatic which i never think ..Keep writing and grwoing your self

Birth certificate in delhi
Birth certificate in ghaziabad
Birth certificate in gurgaon
Birth certificate in noida
How to get birth certificate in ghaziabad
how to get birth certificate in delhi
birth certificate agent in delhi
how to download birth certificate
birth certificate in greater noida
birth certificate agent in delhi
Birth certificate in delhi

Anbarasan14 said...

I am happy reading your blog, I gained a piece of knowledge. Kindly continue the work.
Spoken English Classes in Chennai
Spoken English in Chennai
Top 10 Spoken English Classes in Chennai
Best IELTS Coaching in Chennai
IELTS Coaching Centre in Chennai
English Classes in Mumbai
English Speaking Classes in Mumbai
Best IELTS Coaching in Mumbai
IELTS Coaching in Mumbai
Spoken English Class in Anna Nagar

atharveducation said...


Nuvigil smart drug is the trade name for Armodafinil smart drug and is the enantiopure compound of Modafinil. There are a number of health benefits that the use of Nuvigil smart drug has to offer to its users. So, you can buy Nuvigil online. The use of the smart drug is safe and has no health issues attached to its usage. In the year 2006, the FDA approved the use of generic Nuvigil smart drug to be used to treat a number of mental issues. Buy Nuvigil online as the use of Nuvigil smart drug has long effect when compared to other smart drugs. This is mainly because Armodafinil smart drug has a longer half-life than the other smart drugs. Therefore more and more people are depending on Nuvigil smart drug to carry on their daily routine smoothly.
Buy Nuvigil online

Customer relationship management said...

Very interesting blog Thank you for sharing such a nice and interesting blog and really very helpful article.python training in bangalore

Customer relationship management said...

Its really helpful for the users of this site. I am also searching about these type of sites now a days. So your site really helps me for searching the new and great stuff.vmware training in bangalore

Customer relationship management said...

Very useful and information content has been shared out here, Thanks for sharing it.aws training in bangalore

Customer relationship management said...

I gathered a lot of information through this article.Every example is easy to undestandable and explaining the logic easily.mulesoft training in bangalore

Customer relationship management said...

These provided information was really so nice,thanks for giving that post and the more skills to develop after refer that post.salesforce developer training in bangalore

Customer relationship management said...

Your articles really impressed for me,because of all information so nice.salesforce admin training in bangalore

Customer relationship management said...

Linking is very useful thing.you have really helped lots of people who visit blog and provide them use full information.devops training in bangalore

Customer relationship management said...

Being new to the blogging world I feel like there is still so much to learn. Your tips helped to clarify a few things for me as well as giving.servicenow training in bangalore

Customer relationship management said...

Really it was an awesome article,very interesting to read.You have provided an nice article,Thanks for sharing.informatica training in bangalore

Customer relationship management said...

I know that it takes a lot of effort and hard work to write such an informative content like this.cloud computing training in bangalore

Customer relationship management said...

Your articles really impressed for me,because of all information so nice.sap tm training in bangalore

Customer relationship management said...

Linking is very useful thing.you have really helped lots of people who visit blog and provide them use full information.sap simple logistics training in bangalore

Customer relationship management said...

Being new to the blogging world I feel like there is still so much to learn. Your tips helped to clarify a few things for me as well as giving.sap wm training in bangalore

Customer relationship management said...

Really it was an awesome article,very interesting to read.You have provided an nice article,Thanks for sharing.sap ewm training in bangalore

Customer relationship management said...

This is really an awesome post, thanks for it. Keep adding more information to this.sap mm training in bangalore

watson said...

Thanks for sharing this blog. This very important and informative blog.hadoop training institutes in bangalore

Bangalore Training Academy said...

I am really happy to say it’s an interesting post to read. I learn new information from your article, you are doing a great job. Keep it up…

Upgrade your career Learn AWS Training from industry experts get Complete hands-on Training, Interview preparation, and Job Assistance at Bangalore Training Academy Located in BTM Layout.

Softgen Infotech said...

Very interesting, good job and thanks for sharing such a good blog.

Upgrade your career Learn SharePoint Developer Training in Bangalore from industry experts get Complete hands-on Training, Interview preparation, and Job Assistance at Softgen Infotech.

Repairtech Solutions said...

I couldn’t resist commenting. Exceptionally well written! onsite mobile repair bangalore Saved as a favorite, I like your blog! asus display repair bangalore Great post. I am experiencing many of these issues as well.. huawei display repair bangalore

Repairtech Solutions said...

Hey there! I simply would like to give you a big thumbs up for your great info you've got right here on this post. I'll be coming back to your web site for more soon. online laptop repair center bangalore When I originally left a comment I appear to have clicked on the -Notify me when new comments are added- checkbox and from now on whenever a comment is added I receive four emails with the exact same comment. There has to be a way you can remove me from that service? Appreciate it! dell repair center bangalore

Repairtech Solutions said...

The next time I read a blog, Hopefully it won't fail me as much as this one. I mean, Yes, it was my choice to read, but I genuinely thought you would probably have something helpful to say. All I hear is a bunch of whining about something you could fix if you weren't too busy seeking attention. macbook repair center bangalore Spot on with this write-up, I actually believe this website needs far more attention. I’ll probably be returning to see more, thanks for the information! acer repair center bangalore


Softgen Infotech said...

Really i appreciate the effort you made to share the knowledge. The topic here i found was really effective...

Softgen Infotech have the best Python Training in Bangalore . Any professional who is looking out to switch their career can enroll with us.

eTechno Soft Solutions said...

Really i appreciate the effort you made to share the knowledge. The topic here i found was really effective...

Looking for SAP FICO Training in Bangalore , learn from eTechno Soft Solutions SAP HR HCM Training on online training and classroom training. Join today!

Customer relationship management said...

Its really helpful for the users of this site. I am also searching about these type of sites now a days. So your site really helps me for searching the new and great stuff.

aws training in bangalore

aws courses in bangalore

aws classes in bangalore

aws training institute in bangalore

aws course syllabus

best aws training

aws training centers

Customer relationship management said...

This is the exact information I am been searching for, Thanks for sharing the required infos with the clear update and required points. To appreciate this I like to share some useful information.

mulesoft training in bangalore

mulesoft courses in bangalore

mulesoft classes in bangalore

mulesoft training institute in bangalore

mulesoft course syllabus

best mulesoft training

mulesoft training centers

Customer relationship management said...

It is very good and useful for students and developer.Learned a lot of new things from your post Good creation,thanks for give a good information.

salesforce developer training in bangalore

salesforce developer courses in bangalore

salesforce developer classes in bangalore

salesforce developer training institute in bangalore

salesforce developer course syllabus

best salesforce developer training

salesforce developer training centers

Customer relationship management said...

I have to voice my passion for your kindness giving support to those people that should have guidance on this important matter.

salesforce admin training in bangalore

salesforce admin courses in bangalore

salesforce admin classes in bangalore

salesforce admin training institute in bangalore

salesforce admin course syllabus

best salesforce admin training

salesforce admin training centers

Customer relationship management said...

Excellent post for the people who really need information for this technology.

servicenow training in bangalore

servicenow courses in bangalore

servicenow classes in bangalore

servicenow training institute in bangalore

servicenow course syllabus

servicenow course syllabus

servicenow training centers

Customer relationship management said...

Very useful and information content has been shared out here, Thanks for sharing it.

cloud computing training in bangalore

cloud computing courses in bangalore

cloud computing classes in bangalore

cloud computing training institute in bangalore

cloud computing course syllabus

best cloud computing training

cloud computing training centers

Customer relationship management said...

Awesome post with lots of data and I have bookmarked this page for my reference. Share more ideas frequently.

dell boomi training in bangalore

dell boomi courses in bangalore

dell boomi classes in bangalore

dell boomi training institute in bangalore

dell boomi course syllabus

best dell boomi training

dell boomi training centers

meritstep Technology said...

Thanks for Sharing This Article.It is very so much valuable content. I hope these Commenting lists will help to my website
servicenow online training
top servicenow online training
best servicenow online training

Nannu said...

Thanks for provide great informatic and looking beautiful blog, really nice required information & the things i never imagined and i would request, wright more blog and blog post like that for us. Thanks you once agian

court marriage in delhi ncr
court marriage in delhi
court marriage in noida
court marriage in ghaziabad
court marriage in gurgaon
court marriage in faridabad
court marriage in greater noida
name change online
court marriage in chandigarh
court marriage in bangalore

TrudyAdah said...

This is too informative and interesting. Thanks for sharing an informative blog with us. keep doing.
Regards,
Digital Marketing Company in Chennai
eCommerce Development Company
Best Online Payment Gateway
ERP Services

Mahi said...

Our training institute is the best place to learn foreign languages. Enroll for the best German Language training center in Bangalore. Our Foreign Language School specialists in German language education. Join the best foreign language classes, training institute, coaching centers, tutors, instructors in Bangalore.

German Language Training in Bangalore

German Training Institute in Bangalore

German Institute in Bangalore

German Language Institute

Indian Institute of German & German Language

German Learning

German Language Institute in Bangalore

German Courses

German language course in Bangalore

learn German language in Bangalore

German language basics learning in Bangalore

learn German grammar in Bangalore

German learning centres contact addresses in Bangalore

German grammer tuition phone numbers in Bangalore

reviews of German language learning centres in Bangalore

ratings of German spoken classes in Bangalore

Mahi said...

SAP ABAP Training in Bangalore with 100% placement. We are the Best SAP ABAP Training Institute in Bangalore. Our SAP ABAP courses are taught by working professionals who are experts in.

sap abap training in bangalore

sap abap courses in bangalore

sap abap classes in bangalore

sap abap training institute in bangalore

sap abap course syllabus

best sap abap training

sap abap training centers

Jack sparrow said...


Well thats a nice article.The information You providied is good . Here is i want to share about dell boomi training and Mulesoft Training videos . Expecting more articles from you .

Mahi said...

Artificial Intelligence AI Course in Bangalore with 100% placement. We are the Best Artificial Intelligence AI Course Institute in Bangalore. Our Artificial Intelligence AI course and Certification courses are taught by working professionals who are experts in Artificial Intelligence AI.

Artificial Intelligence AI Training in Bangalore

Artificial Intelligence AI course in bangalore

Artificial Intelligence AI in bangalore

Artificial Intelligence AI classes in bangalore

Artificial Intelligence AI course institute in bangalore

Artificial Intelligence AI course and Certification course syllabus

best Artificial Intelligence AI course

Artificial Intelligence AI course centers

Mahi said...

Our training institute is the best place to learn foreign languages. Enroll for the best Spanish Language training center in Bangalore. Our Foreign Language School specialists in Spanish language education. Join the best foreign language classes, training institute, coaching centers, tutors, instructors in Bangalore.

Spanish Language Training in Bangalore

Spanish Training Institute in Bangalore

Spanish Institute in Bangalore

Spanish Language Institute

Indian Institute of Spanish & Spanish Language

Spanish Learning

Spanish Language Institute in Bangalore

Spanish Courses

Spanish language course in Bangalore

learn Spanish language in Bangalore

Spanish language basics learning in Bangalore

learn Spanish grammar in Bangalore

Spanish learning centres contact addresses in Bangalore

Spanish grammer tuition phone numbers in Bangalore

reviews of Spanish language learning centres in Bangalore

ratings of Spanish spoken classes in Bangalore