/drive/community?hl=en
/drive/community?hl=en
7/31/16
Original Poster
Straafe

Google Drive Error D41D "Unspecified Error" when trying to upload/sync large amount of files (700GB/1.2 Million files)

Hello. So, I've used Dropbox for 8 years now, and generally have had a great experience with it. My main projects folder has reach about 700GB, and consists of over 1 million files. Recently, however, Dropbox has been having issues syncing even though I am well under my 1TB limit. Sometimes it gets stuck at certain stages like "Indexing", crashes randomly, etc. Since I use this directory every day for work and need it synced every single day, this is obviously unacceptable.So, I figured I would try out Google Drive, I've heard nothing but good things about it and as I lost faith in Dropbox I began to become more and more hopeful about Google Drive.I uninstalled Dropbox, installed Google Drive, and copied my entire 700GB, 1+ Million files over to my Google Drive folder. At first, after thinking for a bit, it looks great. Google Drive reports that "1.2 million files will be uploaded and synced." Great. I press "OK." But then, after maybe 10 minutes, I get a popup saying Google Drive needs to close because of an unspecified error. "D41D" most of the time (or maybe every time) I think.After restarting a trying again, and getting the error again, it says something about disconnecting my account and trying again. Sigh. I disconnect my account. I uninstall Drive. I reinstall drive. Everything looks good again for a while. Then the unspecified error again. This can't be real.I've already paid for the first month of the 1TB subscription plan and haven't even been able to get it to start uploading my files. Why does Dropbox and Drive offer plans 1TB or bigger if they can't even handle the files? I'm losing hope, and I'm losing time, and I'm losing money since I need my files on the/any cloud as I work.What can I do? Are there any cloud services like Drive or Dropbox that support more than 1/2 a TB reliably? By the way, I am on a brand new workstation computer with a clean and updated Windows 10 Installation and almost 100% new hardware. I have a decent internet connection. It's definitely the software acting up, but I can;t figure out why. 
Community content may not be verified or up-to-date. Learn more.
Recommended Answers (3)
Were these answers helpful?
How can we improve them?
All Replies (194)
8/1/16
Original Poster
Straafe
Bump. Please, anybody?
8/1/16
Original Poster
Straafe
Here's the sync log file, (I'm trying to sync again right now, don't know if that affects this file at all)https://www.dropbox.com/s/ul7vx3bokqfac9o/log.zip?dl=0
CreativeArt
8/2/16
CreativeArt
We have the same problem here. Did you find a solution ? 
Google user
8/2/16
Google user
Error D41D on Windows is a memory error. The Windows version of the product currently has difficulty syncing large numbers of files at once due to the memory constraints on 32-bit applications, even if your machine has a lot of memory. The number of files it can handle at once varies a bit, but it can't reliably do a million at once. The actual size of the files isn't much of a factor.

I would recommend moving those files back out of your local Drive folder and starting the app. Once it has settled, move them in a little at a time, preferably fewer than 100k at once, waiting for the sync to complete before the next batch. The limitation is not on the number of files synced, but the number of files actively syncing.

If you later need to sync all these files down to another Windows machine, you will probably need to use the Selective Sync option to only sync down a few folders at a time, adding more later.

If you happen to have a Mac available to do these uploads, this limitation should not exist in the Mac version of the client.
BarberSchool
8/2/16
BarberSchool
I was receiving the same error "D41D" and then realized it was from trying to download Google drive through FireFox. Once I did the download through Google Chrome, it cleared up. 
188 MORE
Google user
8/7/17
Google user
Straafe, the current release of the product (now rebranded to "Backup & Sync") is still a 32-bit binary, but it does already ship with the large address aware bit flipped. It's also more memory efficient than previous releases and can handle more files than before, but even so I don't think the Windows client is quite up to syncing 1 million items in one go just yet. There are more memory usage improvements in the pipeline, but I'm no longer on the Drive Sync team so I don't know the status of those or new estimated limits.
 
This question is locked and replying has been disabled. Still have questions? Ask the Help Community.

Badges

Some community members might have badges that indicate their identity or level of participation in a community.

 
Expert - Google Employee — Googler guides and community managers
 
Expert - Community Specialist — Google partners who share their expertise
 
Expert - Gold — Trusted members who are knowledgeable and active contributors
 
Expert - Platinum — Seasoned members who contribute beyond providing help through mentoring, creating content, and more
 
Expert - Alumni — Past members who are no longer active, but were previously recognized for their helpfulness
 
Expert - Silver — New members who are developing their product knowledge
Community content may not be verified or up-to-date. Learn more.

Levels

Member levels indicate a user's level of participation in a forum. The greater the participation, the higher the level. Everyone starts at level 1 and can rise to level 10. These activities can increase your level in a forum:

  • Post an answer.
  • Having your answer selected as the best answer.
  • Having your post rated as helpful.
  • Vote up a post.
  • Correctly mark a topic or post as abuse.

Having a post marked and removed as abuse will slow a user's advance in levels.

View profile in forum?

To view this member's profile, you need to leave the current Help page.

Report abuse in forum?

This comment originated in the Google Product Forum. To report abuse, you need to leave the current Help page.

Reply in forum?

This comment originated in the Google Product Forum. To reply, you need to leave the current Help page.