Need to Know Podcast–Episode 100

Holy flying sharks Batman, the Need to Know Podcast has reached 100 regular episodes! Who would have ever thought back in 2010 when I kicked the podcast off, that I’d still be putting it out? Although the episodes haven’t been as regular as I would have liked over the years I thank everyone who has taken the time to listen and especially those people who have been guests. My guests have given both their time and knowledge to listens which I really appreciate.

So now it is onwards and upwards to the next 100 episodes. If you haven’t already, I’d really appreciate you leaving a review on iTunes or just dropping me a line (director@ciaops.com) and letting me know what you think and importantly if there is anything I can do to improve the podcast. Once again, thanks to everyone who has supported the podcast over its first 100 episodes and I’ll work hard to make sure the next 100 are even better.

As a follow on from our last episode on Azure storage, Marc and I now focus on the different storage options in Office 365 and how to take advantage of each. We consider best practices for data migrations as well as what experience has taught us when moving information to Office 365.

You can listen to this episode at:

http://ciaops.podbean.com/e/episode-100-office-365-storage/

or subscribe to this and all episodes in iTunes at:

https://itunes.apple.com/au/podcast/ciaops-need-to-know-podcasts/id406891445?mt=2

The podcast is also available on Stitcher at:

http://www.stitcher.com/podcast/ciaops/need-to-know-podcast?refid=stpr

Don’t forget to give the show a rating as well as send me any feedback or suggestions you may have for the show.

Resources

Marc Kean – @marckean

Robert Crane – @directorcia

Azure via CSP

Where to put data in Office 365

Microsoft Build Conference

Azure VMs Backup

Azure Resource Manager Virtual Networks

Ingram Cloud Elevate Bootcamp 4

image

I’m doing another session around SharePoint in Melbourne, Perth and Sydney in mid-April for Ingram and encourage you to come along. You can register here:

http://www.adfirm.com.au/email/im-edm/1603IM-Cloud-Elevate-Bootcamp-Registration.html

Details

Introduction to Sharepoint Online and Managed Services.

Creating your own repeatable IP is key to maximising profit for every MSP. SharePoint Online within the Office 365 tool box is the perfect platform to start building that. It also serves as great way to introduce your clients to world of possibilities you can help them achieve around automating many of their day to day tasks.

Be it a simple holiday calendar, receipt tracker or even just taking advantage of implementing many of the prebuilt apps, building a templated set of tools you can apply to all your clients allows for high margin implementation and support – plus leading the way to even more the further you get into your client’s business.

Maximize your profits with ConnectWise® CloudConsole™ by reducing time spent managing Office 365 user accounts and time savings from automating the billing process, saving you time counting users and updating agreements. Increase control by proactively monitoring Office 365 services so anytime there is a disruption or outage, you can be alerted to inform your clients.

Join us for the Cloud Elevate Bootcamp to understand how you can enable your customers to automate their business processes using Office 365 SharePoint with Robert Crane, Microsoft MVP. Plus , Jeff Tessier from Connectwise to understand how it can help you automate your Office 365 business.

Topics include:

Session 1:

Introduction to SharePoint Online & OneDrive for Business: Learn how to create and sell a SharePoint Online Intranet, create a site, deploying the site using a template and creating a sales/marketing process around that. This session will help you put in place the building blocks for introducing your clients to Office 365 SharePoint with basic document libraries and workflows and prebuilt apps.

Session 2:

Introduction to Connectwise Cloud Console: ConnectWise® CloudConsole™ is a management, monitoring, and billing tool for Microsoft® Office 365™, built to save you time and reduce the complexity of supporting your clients’ Office 365 licenses.

I hope to see you there.

Improvements in Office 365 Video

I’m a big fan of the productivity benefits that video can provide a business as evidenced by both my YouTube channel and my online training academy. I’m also a huge fan of Office 365 video and am excited by the new updates Microsoft have just announced here:

What’s new – Office 365 video

There are plenty of improvements and a big one for me is the improved upload experience. However, I’ll also point out the improved way with which an Office 365 video can be embedded into a Team Site.

image

You’ll now see a dedicated Office 365 Video button when you edit a page as shown above.

image

This will then allow you to select from what has been uploaded to Office 365 video quickly and easily.

Office 365 Video March 1

I also really like the improved statics you can now obtain on each video to help not only determine how popular it is but also how long people actually spend watching the content. That feedback really helps improve the quality of the video.

It really is amazing the depth of tools that Office 365 brings to any business. I think more people need to look at Office 365 Video and the benefits it can provide around on-boarding, training, etc. These improvements from Microsoft are even more reason to start using Office 365 in your business.

Where to put data in Office 365?

image

Office 365 has lots of choice when it comes to storing corporate information and that confuses many people. The first place to start to avoid confusion is to understand exactly where information can be placed inside Office 365 and whether that information is available to all users or just an individual by default.

Hopefully the above diagram makes things a little bit easier to understand and here’s a breakdown of what it’s all about

The large box that contains everything is Office 365.

The first box in the top left is Exchange Online. This can contain a user’s personal mailbox (which is private), shared mailboxes (which are public) and public folders (which are public). Into the Exchange box you normally store emails shared between the three smaller boxes within.

The second box on the top row in the middle is SharePoint. This contains OneDrive for Business (which is private), Team Sites (which is public) and Video (which is public). Into the SharePoint box you normally store files shared between the three smaller boxes within.

The box in the top right of the first row is Yammer into which goes conversations (or discussions) that are public.

The box on the left in the bottom row is Office 365 Groups which are composed of a public shared mailbox and a public shared OneDrive for Business. Thus, any information that goes into the Office 365 Groups box will be public. Into the Groups box you normally store files and emails that should to be stored together because they relate to a single topic.

The box on the right in the bottom row is Office 365 Planner which is comprised of public Groups and public Tasks. Thus, any information that goes into Planner will be public. Into Planner you normally store files, emails and tasks that need to be stored together (i.e projects) because they relate to a single topic.

As you can see by the colour scheme, green is shared information amongst the business while red is private information unique to an individual user.

Of course you don’t need to use every storage location in Office 365 that is available to you immediately and your usage locations may also change over time. Best practice is to start with information in Exchange, then expand into Office 365 Groups, then Planner, then SharePoint and finally Yammer. The important thing to remember is that Office 365 gives you lots of choice of where to save your information, it is up to you to work out what makes the most sense for your business.

Hopefully, that makes a little easier to understand when it comes to determining where to put different types of information. Let me know what you think by leaving a comment or contacting me directly (director@ciaops.com).

Migrating On Premises SharePoint to Office 365

A very common request I receive is about migrating an on-premises SharePoint installation (typically Companyweb on Small Business Server) to Office 365. I have done a few previous blog posts on the topic but I think it is time to revisit this topic and share the challenges and ways I have overcome these.

Start fresh

The initial starting point for any SharePoint migration should always be asking the question, is it quicker, easier and better to start from scratch? Most smaller on premises SharePoint installations don’t contain a lot of data and have generally been thrown together in a very ad hoc manner. In this case, it is probably best to consider the migration to Office 365 SharePoint Online as an opportunity for a ‘fresh beginning’.

Any SharePoint environment should be governed by a least a little planning and forethought, which I can assure you will pay huge dividends down the track. So, if you are starting again, take a moment to do some planning and understand exactly what you want from SharePoint Online using the experience you have gained from previous on premises installation.

Copying files

As the size and complexity of local installations of SharePoint grows so too does the reluctance to start again, which is totally understandable. However, it is important that in most cases you can’t simply ‘move’ SharePoint for reasons I’ll go into shortly. You can however ‘move’ file data by simply mapping a drive to the source and destination and copying / pasting between locations. the downside of using this method is that you are going to only bring the files across, not any of the associated properties such as previous versions, check ins, workflows, etc. However, if SharePoint has simply been used as a document dumping ground then just map a location using Windows Explorer for the source and destination, then drag and drop between them.

To get a better understanding of how to map a drive in SharePoint have a look at my video:

Uploading documents to SharePoint Online

Templating

More complex SharePoint sites also typically contain other things such as calendars, contact lists, announcements and so on. These can’t generally be copied directly across they need to be migrated.

If you are migrating between identical versions of SharePoint i.e. 2013 on premises to Office 365, then you can template the source elements, including the data contained within, and then import into the destination. A fairly arduous task if there are are lots of different elements but provided you have SharePoint 2013 on premises the process is pretty straight forward.

This video of mine will give you a basic idea of how to template a site:

Saving a SharePoint Online site as a template

Migrating between different versions of SharePoint

The challenge arises when you DON’T have SharePoint 2013 on premises. This is the case with Small Business Server (SBS) which has SharePoint Foundation 2010 (SBS 2011), Windows SharePoint Services 3.0 (SBS 2008) and Windows SharePoint Services 2.0 ( SBS 2003). The rule with SharePoint is that you can’t take a template from one version and use it on another version. Thus, you can’t take a template of something from SharePoint Foundation 2010 and import it directly into Office 365, it needs to be migrated.

The first solution to this problem is to upgrade the on premises version of SharePoint to SharePoint 2013 so it matches that in Office 365. For SharePoint Foundation 2010 this means a single upgrade to SharePoint Foundation 2013, However for WSS v3 this means 2 migrations, the first to SharePoint Foundation 2010 and the second to SharePoint Foundation 2013 and then to Office 365. You can probably guess the story for the upgrade of WSS v2.0. It needs to be migrated to WSS v3, then 2010, then 2013 and then to Office 365.

SBS is also a special case (as it always is) in that you should NOT be upgrading it as it will break everything. Thus, doing an in place upgrade is not an option for SBS (and besides SharePoint 2013 no longer supports in place upgrades).

Typically this on premises migration is done using a database swing process which basically copies the old database to a new SharePoint server installation and then attaches it using a command line option. During this process the old database is upgraded to the new SharePoint version. if you want to learn more about this database attach method I suggest you consult my freely available comprehensive SharePoint Guides at:

SharePoint Foundation 2010 Guide

Windows SharePoint Services Guide

Thus, an upgrade from WSS v3 is going to mean two database swing migrations even before attempting to got to Office 365.

It is important to be aware that any SharePoint migration from an old version will never be prefect. Some features (if utilised in the old version) are not available in the never version. The main change is the fact that things look very different when you migrate SharePoint versions doing a database swing.

Third party tools

The better way to approach the migration process is to use a third party tool that will not only move the data but also upgrade the information on the fly. I have spoken previously about some options I have used:

Migrating from Companyweb to Office 365 SharePoint

but by far and away the best is Sharegate. It is very simply to use, yet extremely powerful to use. It truly makes migration from previous versions a breeze.

A good example, is that I recently used Sharegate to migrate from a 12 year old on premises WSS v2 installation to Office 365 with success. It wasn’t exactly straight forward but Sharegate made life so much easier than doing it any other way.

The challenge with Companyweb

There still remains a challenge with SBS systems because third party tools like Sharegate require direct access to the SharePoint site. This works fine if you are on premises running Sharegate from a workstation on the network but what if you want to do it remotely like I was? It’s simple. You can’t without major changes to SBS and your local firewall configuration because Companyweb is effectively hidden behind Remote Web Workplace (RWW), meaning there is no easily way to provide direct access.

The solution was going to be to copy the SharePoint site to a new stand alone server that was configured to be directly on the Internet and then use Sharegate. This is going to mean the need to run a copy of WSS v3 somewhere.

A while back I detailed how I used to do this using on premises virtual machines hosted on a laptop but I now had this set up in Azure:

I finally get Azure

What I have there is two things I need to complete this task. Firstly, I have a demo WSS v3 machine, fully patched and secondly I have a workstation on which I have Sharegate installed.

Thus, the next task to accomplish was getting the WSS v3 server in Azure up and running with the data from the on premises SBS instance. This meant getting a copy of the on premises SharePoint databases and attaching them to the WSS v3 installation in Azure. The trick was getting the on premises SharePoint database into Azure given that it was a few gigabytes.

The solution to this upload problem is relatively easy. What I did was create an Azure SMB file share per:

Creating an Azure SMB fileshare

and had the on premises SharePoint databases uploaded here by simply mapping a drive letter to Azure from a local workstation.

Once the database was in Azure I simply mapped that same SMB file sshare to my WSS v3 Azure virtual machine and copied the databases to the appropriate location on the virtual machine. I then attached these uploaded databases to WSS v3. Once complete, I then had a direct copy of the on premises SharePoint server but now directly accessible via the Internet.

I then fired up my Azure VM with a copy of Sharegate on it. I connected Sharegate to the source WSS v3 site, now in Azure, and the destination Office 365 SharePoint Online. I configured Sharegate appropriately and then stepped back to let it do its magic.

You may be asking, why didn’t you just run Sharegate on you local machine? Why do you need to use a virtual machine hosted in Azure to run the migration tool? Here’s why kids. I learnt during an early SharePoint migration that things ALWAYS take far longer than you expect. In my case I was on the client’s premises still doing the migration as the end of day approached. I couldn’t easily leave because that would mean stopping the migration and returning when they reopened, since I would need to power off my local workstation. I therefore figured out that if I did everything in an Azure virtual machine I could simply disconnect and leave the VM running and not interrupt the migration. I could then easily relocate elsewhere and reconnect to the still running migration session. Much more flexible I think you’ll agree, so that’s the way I do all migrations now. You gotta love Azure don’t you?

Once the Sharegate migration was complete, I checked the logs and the destination. I then let the client know that the migration was complete and they should check the result to ensure they were happy. Of course there still things that will need to be fixed because the source site did things not supported in SharePoint 2013 and used bad practices like direct URL links, but these are relatively minor problems and easily rectified. In one swoop, the site was upgraded from WSS v3 to SharePoint 2013 and moved to Office 365. The power of third party tool ins action. Thank you Sharegate.

Sharegate is a fantastic tool but the its only downside is the fact that it is rather expensive. This puts it out of the reach of most small businesses and resellers, especially if they only need to do a single migration. I have put a case to Sharegate that they look at a cheaper offer for SMB. Hopefully they’ll be open to that but in my opinion, Sharegate is the premier tool for SharePoint migrations, bar none.

Migrating on premises SharePoint to Office 365 is a challenge and there are many ways of approaching it (SBS even more so). To do a complete content migration in one swoop you’ll need a third party tool, and I have said, my recommendation is Sharegate. However, if you don’t have the skill set to do this or find Sharegate a bit beyond your budget then you really need to contact me (director@ciaops.com) so I can help you. Hopefully, as you can tell from this post, I do this sort of thing a lot and have the tools and set up to streamline the process and therefore make it far more cost effective for those smaller and one off migrations. So don’t be afraid to contact me directly (director@ciaops.com) for advice and assistance for your on premises to Office 365 SharePoint migration. I’m here to help.

Please support my free content efforts at http://patreon.com/ciaops where as a supporter you can access other benefits.

SharePoint Online Team Site storage now 1TB

Today is a GOOD DAY! Microsoft have delivered on their promise to increase the default starting Team Site pooled storage from 10GB to 1TB as announced in this blog post:

Auditing, reporting and storage improvements for SharePoint Online and OneDrive for Business

and I quote:

1 TB additional space for overall pooled SharePoint Online storage allocation

The amount of content in Office 365 is growing 300 percent year over year. To meet your needs for more storage, we’re increasing default storage to 1 TB plus 0.5 GB per user to use across SharePoint Online, Office 365 Groups and Office 365 Video—up from the previous allocation of 10 GB. This is in addition to the unique default per-user OneDrive for Business storage space and individual storage provided for user email inboxes.

I can also happily report that I am seeing this increase inside my own tenant already:

image

It has taken quite a while to get the old 10GB limited upgraded to 1TB and that is going to make life so much easier for businesses moving to Office 365. This is because the area in which shared information for people needs to go is into Team Sites NOT OneDrive for Business as I have said many times. Now having 1TB as a starting point means most businesses won’t need to purchase additional space for their shared information. It should also place the focus back on the more powerful Teams Sites for business information and away from OneDrive for Business which is designed for individuals.

I really believe this is such an important upgrade and will remove one of the major restrictions businesses have had around moving from traditional on-premises servers to Office 365.

Happy days!

Working with Remote SharePoint Drop Off Libraries

A while ago I detailed how to set up SharePoint Drop Off Libraries so documents would be automatically routed within a Team Site. You’ll need to review that post:

Working with SharePoint Drop Off Libraries

because this post will show you how to route documents using Drop Off Libraries between two different Team Sites.

image

The most important thing you need to ensure is enabled in the source Drop Off Library location is that the option for Sending to Another Site is enabled in the Content Organizer Settings as shown above.

image

You’ll then need to follow the same procedure as the the initial post detailed about enabling a Drop Off Library in the destination Team Site. You’ll need to configure the appropriate rules so that any document uploaded to the destination Drop Off Library ends up in the correct location within that local Team Site.

To link the source Drop Off Library to the destination in another location, navigate to the Content Organizer Settings in the destination site. Scroll to the bottom of the page and there you’ll see a heading Submission points as shown above. Copy the URL that is shown there. that URL should end with something

/_vti_bin/OfficialFile.asmx

image

You’ll then need to navigate to the SharePoint admin center and select the Records Management option from the menu on the left.

Select option New Connection, then paste the URL into the Send to URL box as shown above. Also, enter a description into the Display name field, make any other changes and save the configuration.

image

Now navigate to the source Drop Off Library location and create or edit a Content Organizer Rule. Complete all the details as before but for the target location, as shown above, you should be able to select a target as Another content organizer in a different site. You should then be able to select the connection display name you just created in the SharePoint Admin center. Save the rule when complete.

image

In this case, there are now two rules for the source Drop Off Library based on what is entered into the Title field. One rule routes to a local Picture Library in the current site (the top rule), the other routes to a Picture Library in a completely different Team Site (the second rule).

image

If a document is now uploaded to the source Drop Off Library and submitted with the appropriate condition (here the Title field is set to Team).

image

The document is corrected routed to the subsite as shown above.

image

Where it is the routed by the local Drop Off Library to the final destination as shown above.

So in summary, to route a document from a source Drop Off Library to a destination library in another Team Site requires configuring a connection to the destination in the SharePoint admin center, then using that connection as the destination for the Content Organizer rule.

A little bit of configuration, but once operating it provides a powerful way of automatically routing documents to the correct location ANYWHERE with SharePoint Online. That means less time is wasted by users working out where to put documents and secondly it allows routing to multiple location using rules. Thus, you could in theory have a single drop off point in SharePoint routing to various locations. Now wouldn’t that make life easier for everyone?

Working with SharePoint Drop Off Libraries

One of the major challenges businesses face is how to ensure their digital information is stored in the correct location. Unless people know exactly where it needs to go it will probably end up where it isn’t supposed to be.

A smart way to approach this problem is to use automated processes governed by rules that allow people to upload information to a single location and then for it to automatically routed to the right location without them having to think about it.

SharePoint has plenty of automation features available out of the box. One of these is a feature known as Document Routing. This allows you to basically configure a number of rules so when a file is uploaded to a special ‘drop-off’ area in SharePoint it is automatically moved to other locations based on these rules.

image

Firstly, navigate to the SharePoint Team Site where you wish to enable this.

image

In the top right of the window select the COG and then Site Settings from the menu that appears.

image

From under the Site Actions section in the right column select Manage site features.

image

Locate the feature Content Organiser and ensure that it is Active as shown above.

image

Once the Content Organizer feature is active it will automatically create a new Document Library in the Team Site called Drop Off Library as shown above.

image

Go back to the Site Settings area in the Team Site and locate the Site Administration area options as shown above.

Here you will now see two additional options – Content Organizer Settings and Content Organizer Rules.

Select Content Organizer Rules.

image

image

You can follow through the options on the page but here, enable the ability to Send to Another Site which is not enabled by default.

image

At the bottom of this page you find the ability to send email notifications when data remains in the Drop Off Library. This means that the data doesn’t match any of the in place rules and needs to be manually resolved.

Here you can nominate which users will receive email notifications of this and how many days the system will wait before notifying them.

Scroll down to the bottom of the page and save your changes.

image

Now select the Content Organizer Rules link. This will take you what appears to be a standard SharePoint list. Select the option new item to create a new rule to organise your data.

image

Give the rule a name and set the priority. Rules work based on SharePoint Content Types. In this case, because we want to route standard images, select the Document Content Types which then allows the selection of Picture for type. This means the rule will only apply to pictures uploaded to the Drop Off Library.

image

You now need to create a condition that will test the information uploaded. In this case the condition used will be when the Title field is set to begin with ‘Home’. Remember, that when you upload a picture file to SharePoint it will also ask you for a range of meta data (Title, Keywords, dates, etc) at the point of upload. This rule will look at that information and make routing decisions on what it finds in the ‘Title’ field.

image

If you scroll down, you’ll find a location to specific the location where any matching documents will be moved to. Select the Browse button.

image

You then locate the destination in the current Team Site. In this case it will be the Picture Library ‘Pictures’.

It is important to remember that you can only send matching documents from this rule (which uses a specific Content Type) to destination locations that also include that same Content Type. In this case, the ‘Document Types’ content is being used because it contains a type ‘Pictures’ which is the same Content Type that is applied to the Picture Library ‘Pictures’. In essence, you can’t move different types of file to locations that don’t accept that style of file. For example, you can’t move documents to a Team Site Calendar.

Once you have selected the destination from the tree, scroll to the bottom of the page and select the OK button to save your changes.

image

That path should now appear in the Destination field as shown above.

Scroll down to the bottom of the page and save your changes.

image

You should now be returned to the rules overview page as shown above, where the rule you just created appears.

image

Navigate to the Drop Off Library in the Team Site and select the option to upload a file.

image

The standard upload dialog box will appear but you should now see additional text at the top indicating that the Content Organizer feature is active.

Select a file to upload using the Choose file button and then OK.

image

The standard file properties dialog will appear that allows you to enter additional information about the uploaded file as shown above. Again, note the additional text at the top of the window indicating that Content Organizer is in operation.

image

In this case, to allow the organising rules to apply, ‘Home’ is added to the Title field.

Select the Check In button in the top left to save these changes.

image

If all is correct, the rule previously created should now be applied and you should receive a message like that shown above indicating that the document uploaded has been successfully re-rerouted to the destination you defined in the rule. In this case the uploaded image is re-rerouted to a Picture Library called ‘Pictures’.

image

If you now navigate to that location, you should see the document you just uploaded.

image

If a document is uploaded to the Drop Off Library and it doesn’t match any of the rules in place you will see the message above. This is basically saying that the document will remain in the Drop Off Library until further action is taken by an administrator.

image

The file will remain in the Drop Off Library until it is updated so the properties match one of the rules and it can be routed.

image

If email notifications have been enabled, those people will receive notification that items remain in the Drop Off Library and require attention before they can re-route as shown above.

In an upcoming post I’ll cover how a document can be re-routed using a similar method to a location outside the current Team Site.

Automating standard processes and procedure is the key to being productive. SharePoint includes many automation features to make life easier and importantly more consistent. Using Drop Off Libraries is but one method and hopefully as I have been able to illustrate, it is easy to set up and use.