Friday 24 May 2013

Scripted Installation of SharePoint 2013 and Office Web Apps Server – From the Field (Part 3)

This is third post in the Scripted Installation of SharePoint 2013 and Office Web Apps Server blog series, covering the following service applications deployment:
  • User Profile
  • Search
  • Distributed Cache
For SharePoint farm topology, installation and provisioning of the basic service applications please see blog one and two of this series.
  1. Farm Topology and Prerequisites
  2. SharePoint Installation, Configuration and Basic Service Applications Deployment
  3. User Profile, Search and Distributed Cache Service Applications Deployment
  4. Office Web Apps Server farm Implementation and Configuration

Prerequisites and Assumptions

  • Please download and extract the attached files onto a local directory on each SharePoint Server. For the purposes of this blog the directory is suggested to be: E:\Scripts\Install.
  • From the downloaded files, update the SPUserProfile.xml file with environment specific information such as, SQL server alias name, service account details, database name, service application name, etc. This will be self-explanatory once you open the file.
  • Also update the SPSearchService.xml file with environment specific information such as, SQL server alias name, service account name and password, database name, service application name, Index Location, etc.

Configure Distributed Cache

The Distributed Cache service can be deployed in two modes: dedicated mode or collocated mode. In dedicated mode, all services other than the Distributed Cache service are stopped on the application server that runs the Distributed Cache service. In collocated mode, the Distributed Cache service runs together with other services on the application server. Dedicated mode is the recommended mode in which to deploy the Distributed Cache service if the total number of users exceed 10,000.
When more than one server is used for Distributed Cache, all the servers must have the same cache size configured.
Please see Planning for Distributed Cache service in SharePoint Server 2013 for more information.
Provision Distributed Cache Service in dedicated mode:
Launch SharePoint Management Shell as administrator and execute the following PowerShell script on all Application, Search and Web Application Servers (all servers apart from Distributed Cache servers SPDCache01 and SPDCache02) to remove them from the Distributed Cache cluster and stop the services:
 $instanceName ="SPDistributedCacheService Name=AppFabricCachingService" 
 $serviceInstance = Get-SPServiceInstance | ? {($_.service.tostring()) -eq $instanceName -and ($_.server.name) -eq $env:computername} 
 $serviceInstance.Unprovision() 
 Stop-SPDistributedCacheServiceInstance -Graceful 
 Remove-SPDistributedCacheServiceInstance 
Change the Memory Allocation of the Distributed Cache Service
When SharePoint Server 2013 is installed, it assigns the Distributed Cache service 10 percent of the total memory on the server. It is recommended to allocate sufficient amount of memory on each Distributed Cache server. Please see Change the memory allocation of the Distributed Cache service to calculate how much memory can be assigned to the Distributed Cache service. It is important to note that the allocated memory on each server should not exceed 16 GB.
Use the following procedure to update the memory allocation accordingly:
Launch SharePoint Management Shell as Administrator on SPDCache01 and SPDCache02 and run the following scripts:
Stop the Distributed Cache service:
 $instanceName ="SPDistributedCacheService Name=AppFabricCachingService" 
 $serviceInstance = Get-SPServiceInstance | ? {($_.service.tostring()) -eq $instanceName -and ($_.server.name) -eq $env:computername} 
 $serviceInstance.Unprovision() 
Reconfigure the cache size of the Distributed Cache service:
 Update-SPDistributedCacheSize -CacheSizeInMB 7168 
Restart the Distributed Cache service:
 $instanceName ="SPDistributedCacheService Name=AppFabricCachingService" 
 $serviceInstance = Get-SPServiceInstance | ? {($_.service.tostring()) -eq $instanceName -and ($_.server.name) -eq $env:computername} 
 $serviceInstance.Provision() 
Change Service Account
When the server farm is first configured, the server farm account is set as the service account of the AppFabric Caching service. The Distributed Cache service depends on the AppFabric Caching service. For security purposes it is advised to change the service account from the farm account. To change the service account of the AppFabric Caching service to a managed account, set the Managed account as the service account on the AppFabric Caching service.
At the Windows PowerShell command prompt, run the following command:
 $farm = Get-SPFarm 
 $cacheService = $farm.Services | where {$_.Name -eq "AppFabricCachingService"} 
 $accnt = Get-SPManagedAccount -Identity DomainName\SVC_SPFabric 
 $cacheService.ProcessIdentity.CurrentIdentityType = "SpecificUser" 
 $cacheService.ProcessIdentity.ManagedAccount = $accnt 
 $cacheService.ProcessIdentity.Update() 
Where the ‘DomainName’ is the NetBIOS domain name.

Configure User Profile Services

Login to SPAPP01 (Application Server hosting the Central Administration site) and launch SharePoint Management Shell as administrator. Execute the following command to start and configure User Profile Service:
 E:\Scripts\Install\SPUserProfile.ps1 -configLocation E:\Scripts\Install\SPUserProfile.xml 
When prompted provide the My Site Application Pool account variable “$MySiteAppPool”

Start User Profile Synchronisation

  1. Ensure that the Farm Admin account (SVC_SPFarm) is a member of local administrators group on SPAPP01.
    Please note this is only required while configuring User Profile synchronisation Settings. However, when a backup of the User Profile application is initiated, the synchronization service provisions the User Profile application again. During the course of provisioning the User Profile application, the farm account must stop and start the synchronization service. To do this, the farm account must be a member of the Administrators group on the computer that is running the synchronization service. Due to this you may decide that the farm account will remain a member of the Administrators group on SPAPP01.
  2. Ensure that the Farm account is able to logon locally on both SPAPP01 and SPAPP02 (Please see http://technet.microsoft.com/en-us/library/ff182925(v=office.15).aspx#permission)
  3. Reboot SPAPP01 after granting above permissions
  4. Starting the user profile synchronisation service introduce the same challenge as we had in SharePoint 2010. This needs to be done under the farm account. There are a number of options:
    1. Login to SPAPP01 using the Farm Admin account (SVC_SPFarm). Navigate to Central Administration Site and click on Services on Server and start User Profile Synchronization Service.
    2. Launch the SharePoint Management Shell as the SVC_SPFarm account and use New-SPProfileServiceApplication Cmdlet.
    3. Use the third option described in: Avoiding the Default Schema issue when creating the User Profile Service Application using Windows PowerShell by Spencer Harbar.
    4. Perform an IIS reset on SPAPP01 server
The following activities are recommended however are out of scope of this blog post:
  1. Add a new synchronisation connection
  2. Define exclusion filters for a synchronisation connection
  3. Map user profile properties
  4. Start profile synchronization and configure Import Schedules

Configure Search Service

Login to SPAPP01 (Application Server hosting the Central Administration site) and launch SharePoint Management Shell as administrator. Execute the following command to start and Search Services and configure the search topology:

 E:\Scripts\Install\SPSearchService.ps1 -configLocation E:\Scripts\Install\SPSearchService.xml 
Please note the following Search post configuration steps are required to be carried out; however, are out of scope of this blog post:
  1. Provide the location of the global Search Centre
  2. Setup People Search
  3. Configure result sources
  4. Configure Search Result Exclusions
  5. Configure Search Alert Settings
  6. Configure Search Crawling Schedule
Lookout for the next blog post, where we implement Office Web Application Components and its integration with SharePoint.

Monday 18 March 2013

Scripted Installation of SharePoint 2013 and Office Web Apps Server – From the Field (Part 2)

This is the second post in the Scripted Installation of SharePoint 2013 and Office Web Apps Server series. If you have not already done so, please see part one of this blog series: Farm Topology and Prerequisites.
  1. Farm Topology and Prerequisites
  2. SharePoint Installation, Configuration and Basic Service Applications Deployment
  3. User Profile, Search and Distributed Cache Service Applications Deployment
  4. Office Web Apps Server farm Implementation and Configuration
This blog post will cover:
  • Installation of SharePoint 2013
  • Farm creation and configuration
  • Implementation of:
    • Excel Services
    • Secure Store
    • Usage and Health Data Collection
    • Managed Metadata Services
    • State Services
  • Configuration of services on servers
  • Configuration of usage and health data collection
  • Configuration of state service
  • Configuration of diagnostic logging

Servers in Farm

The following table illustrates the server names and associated server roles for each server:
 Server Name  Server Role
 SPWEB01  SharePoint 2013 Web Server 1
 SPWEB02  SharePoint 2013 Web Server 2
 SPDCache01  SharePoint 2013 Distribution Cache Server 1
 SPDCache02  SharePoint 2013 Distribution Cache Server 2
 SPAPP01  SharePoint 2013 Application Server 1 (CA)
 SPAPP02  SharePoint 2013 Application Server 2 (CA)
 SPQuery01  SharePoint 2013 Query Processing and Index Server 1
 SPQuery02  SharePoint 2013 Query Processing and Index Server 2
 SPCrawl01  SharePoint 2013 Admin, Crawl, Content Processing, Analytics Processing Server 1
 SPCrawl02  SharePoint 2013 Admin, Crawl, Content Processing, Analytics Processing Server 2

Installation Prerequisites and Assumptions

  • Please download and extract attached files onto local directory. It has been assumed that this directory is local folder on all SharePoint serves created as E:\Scripts\Install
  • It is assumed that the SharePoint installation directory is D:\
  • Update the SilentConfig.xml file with SharePoint product key. Please see Config.xml reference on TechNet for more information.
  • Update the Config.xml file with environment specific information such as, SQL server alias name (To improve ease of maintenance, and make it easier to relocate the database if it is required in the future, create DNS aliases that point to the IP address for all instances of SQL Server), farm account details, admin database and configuration database.  
  • Update the SPCredentials.xml file with service accounts and passwords information.
  • Update the SPServices.xml file with Usage and Health data collection log file location, Usage and Health data collection maximum file size, SQL server name, service application names and related database names.

Install SharePoint

  1. Microsoft SQL Server 2008 R2 Native Client is installed as part of SharePoint 2013 prerequisites installer, however if you are using SQL Server 2012 to host SharePoint databases, Install Microsoft SQL Server 2012 Native Client 64-bit edition on all SharePoint servers.
  2. Install SharePoint prerequisites and SharePoint binaries by executing the following script on all servers listed above (launch SharePoint Management Shell as administrator): 
Set-ExecutionPolicy Unrestricted –force 
E:\Scripts\Install\SPInstaller.ps1 -installPath D:\ -offline "n"
Import-PSSession $session
Please note: Windows PowerShell execution policies let you determine the conditions under which Windows PowerShell loads configuration files and runs scripts. The execution policy is not a security system that restricts user actions. Instead, the execution policy helps users to set basic rules and prevents them from violating them unintentionally. Please see About Execution Policy TechNet article.
This script will automatically restart servers as required. Do not run configuration wizard until installation is completed on all servers
The following steps are performed on individual servers specified in each step:

Create the Farm

Login to SPAPP01 (Application Server hosting the Central Administration site) using the installer account and launch SharePoint Management Shell as administrator. Execute the following command to create the farm:
E:\Scripts\Install\SPConfig.ps1 -configLocation E:\Scripts\Install\Config.xml -createJoin create -isCA "y"

Join Servers to the Farm

Login to SPAPP02 (The second Application Server hosting the Central Administration site) and launch SharePoint Management Shell as administrator. Execute the following PowerShell script:
E:\Scripts\Install\SPConfig.ps1 -configLocation E:\Scripts\Install\Config.xml -createJoin join -isCA "y"
Run the following script on the below SharePoint servers:
E:\Scripts\Install\SPConfig.ps1 -configLocation E:\Scripts\Install\Config.xml -createJoin join -isCA "n"

 Server Name  Server Role
 SPWEB01  SharePoint 2013 Web Server 1
 SPWEB02  SharePoint 2013 Web Server 2
 SPDCache01  SharePoint 2013 Distribution Cache Server 1
 SPDCache02  SharePoint 2013 Distribution Cache Server 2
 SPQuery01  SharePoint 2013 Query Processing and Index Server 1
 SPQuery02  SharePoint 2013 Query Processing and Index Server 2
 SPCrawl01  SharePoint 2013 Admin, Crawl, Content Processing, Analytics Processing Server 1
 SPCrawl02  SharePoint 2013 Admin, Crawl, Content Processing, Analytics Processing Server 2

 Register Managed Accounts

Login to SPAPP01 (Application Server hosting the Central Administration site) using the installer account and launch SharePoint Management Shell as administrator. Execute the following command to register managed accounts in the farm:
E:\Scripts\Install\SPCredentials.ps1 -configLocation E:\Scripts\Install\SPCredentials.xml

Configure Basic Services

Login to SPAPP01 (Application Server hosting the Central Administration site) using the installer account and launch SharePoint Management Shell as administrator. Execute the following command to start required services and stop unwanted ones:
E:\Scripts\Install\SPServices.ps1 -configLocation E:\Scripts\Install\SPServices.xml
 The above script will stop unnecessary services from servers and starts the following service:
  • Excel Services
  • Secure Store
  • Usage and Health Data Collection
  • Managed Metadata Services
  • State Services

Configure Usage and Health Data Collection

Login to SPAPP01 (Application Server hosting the Central Administration site) using the installer account and launch SharePoint Management Shell as administrator. Execute the following command to start and configure Usage Service:
E:\Scripts\Install\SPUsage.ps1 -configLocation E:\Scripts\Install\SPServices.xml

Configure State Service

Login to SPAPP01 (Application Server hosting the Central Administration site) using the installer account and launch SharePoint Management Shell as administrator. Execute the following command to start and configure Usage Service:
E:\Scripts\Install\SPStateService.ps1 -configLocation E:\Scripts\Install\SPServices.xml

You should now have basic services started on all servers in the farm. It is recommended to check Servers in Farm page from Central administrations site to ensure that the correct services are started.
By the end of this blog series the expected farm topology will be as illustrated below:
 Server Name  Server Role  Services
 SPWEB01 Web Server  Microsoft SharePoint Foundation Web Application
 Microsoft SharePoint Foundation Workflow Timer Service
 Managed Metadata Web Service
 SPWEB02 Web Server  Microsoft SharePoint Foundation Web Application
 Microsoft SharePoint Foundation Workflow Timer Service
 Managed Metadata Web Service
 SPDCache01 Distribution Cache  Distributed Cache
 Microsoft SharePoint Foundation Workflow Timer Service
 Microsoft SharePoint Foundation Web Application
 SPDCache02 Distribution Cache  Distributed Cache
 Microsoft SharePoint Foundation Workflow Timer Service
 Microsoft SharePoint Foundation Web Application
 SPAPP01 Application Server  Central Administration
 Excel Calculation Services
 Microsoft SharePoint Foundation Workflow Timer Service
 Secure Store Service
 User Profile Service
 User Profile Synchronization Service
 SPAPP02 Application Server  Central Administration
 Excel Calculation Services
 Microsoft SharePoint Foundation Workflow Timer Service
 Secure Store Service
 User Profile Service
 SPQuery01 Search - Query Processing and Index  Microsoft SharePoint Foundation Workflow Timer Service
 Search Host Controller Service
 Search Query and Site Settings Service
 SharePoint Server Search
 SPQuery02 Search - Query Processing and Index  Microsoft SharePoint Foundation Workflow Timer Service
 Search Host Controller Service
 Search Query and Site Settings Service
 SharePoint Server Search
 SPCrawl01 Search - Admin, Crawl, Content Processing, Analytics Processing  Microsoft SharePoint Foundation Workflow Timer Service
 Search Host Controller Service
 Search Query and Site Settings Service
 SharePoint Server Search
 SPCrawl02 Search - Admin, Crawl, Content Processing, Analytics Processing  Microsoft SharePoint Foundation Workflow Timer Service
 Search Host Controller Service
 Search Query and Site Settings Service
 SharePoint Server Search

Lookout for the next blog post, where we complete the farm configuration by provisioning search, user profile services and distributed cache service.

Monday 18 February 2013

Scripted Installation of SharePoint 2013 and Office Web Apps Server – From the Field (Part 1)


This is the first in a series of posts where I will talk about my involvement in the TAP (Technology Adoption Program) and more specifically a project I was involved in to implement the SharePoint 2013 platform andOffice Web Apps Server farm. I will be sharing my findings and experience that will hopefully help you to:
  • Create a reusable SharePoint 2013 build and configuration guide
  • Implement SharePoint and Office Web Apps Server in a consistent manner using the scripts I will provide throughout this blog post series.
The series is broken down into the following articles that I will write:
  1. Farm Topology and Prerequisites (This article)
  2. SharePoint Installation, Configuration and Basic Service Applications Deployment
  3. User Profile, Search and Distributed Cache Service Applications Deployment
  4. Office Web Apps Server farm Implementation and Configuration

Introduction

This post will focus on providing an overview of the overall farm topology, the end to end build sequence from preparation to testing, recommended service accounts and the prerequisites.

Build Sequence

The following diagram illustrates the high level overview of the steps required to implement and configure the SharePoint and Office Web Apps Server farms. The Office Web Apps server farm requires dedicated hardware and is no longer implemented as a SharePoint service application.

Farm Topology

The server farm topology will have multiple tiers and each tier will have redundant server instances, this is the most common topology that provides an efficient physical and logical layout to support scaling out or scaling up, and provides better distribution of services across the
member servers.

It is important to adopt an iterative design approach to analyse the architecture model, to verify that the model identifies all the elements that are required for the farm solution. 
The Plan for monitoring in SharePoint 2013 TechNet article provides great introduction on tools and scenarios on how to best use them. 
Redundant member servers are hosted on different Hyper-V hosts and Anti-Affinity helps to eliminate single points of failure. It is worth noting that the Deployment guide for SharePoint 2013 eBook, provides great detailed information regarding recommended practices when implementing SharePoint 2013 on a virtualised platform such as:         
  • Leave adequate memory for the Hyper-V partitions - For SharePoint products virtual machines, we recommend 4 GB of RAM or more for host computer operations.
  • Use a minimum of two physical network adapters - For better network management and performance, dedicate one adapter to virtual machine network traffic and use the other adapter for virtualization host network traffic.
  • Do not oversubscribe the CPU on the virtualization host computer - Review the supported ratio of virtual processors per logical processor and avoid oversubscribing the host computer CPU. The optimum virtual processor:logical processor ratio is 1:1. For more information, see Configure the processors for the virtual machines in Deployment guide for SharePoint 2013 eBook.
  • Do not cross Non-uniform memory access (NUMA) boundaries - Hyper-V spans NUMA nodes to assign physical memory to a virtual machine; however, this does reduce performance on the virtual machine. For more information, see Configure the memory for the virtual machines in Deployment guide for SharePoint 2013 eBook.
  • Do not use snapshots in a production environment - Do not use snapshots for the virtual machines in a SharePoint products production environment.  When you create a snapshot, Hyper-V creates a new secondary drive for the virtual machine. Write operations occur on the new drive and read operations occur on both drives, which has the same net affect as a differencing disk. Every snapshot that you add reduces disk performance further.
  • Do not use dynamic memory - The reason is that this implementation of dynamic memory does not work with every SharePoint feature. For example, Distributed Cache and Search do not resize their caches when the allocated memory for a virtual machine is dynamically changed. This can cause performance degradation, especially when assigned memory is reduced.

Service Accounts

The following service accounts are what I have used to create the farm. This list may vary for your implementation depending on Server resources management versus least privilege security recommendation, required service applications and in general what works for your implementation based on the organisations security guidelines and policies.

AccountPurposeRequirements
SVC_SPInst
Setup user account
(Install Account)
The Setup user account is used to run the following:
  • Setup
  • SharePoint Products Configuration Wizard
  • Domain user account.
  • Member of the Administrators group on each server on which Setup is run.
  • SQL Server login on the computer that runs SQL Server.
  • dbcreator and securityadmin
  • This account must be a member of the db_owner fixed database role for the content databases database.
SVC_SPFarmThe server farm account is used to perform the following tasks:
  • Configure and manage the server farm.
  • Act as the application pool identity for the SharePoint Central Administration Web site.
  • Run the Microsoft SharePoint Foundation Workflow Timer Service.
  • Domain user account.
  • Additional permissions are automatically granted for the server farm account on Web servers and application servers that are joined to a server farm.
  • The server farm account is automatically added as a SQL Server login on the computer that runs SQL Server. The account is added to the following SQL Server security roles:
  • dbcreator fixed server role
  • securityadmin fixed server role
  • db_owner fixed database role for all SharePoint databases in the server farm
SVC_SPSvcA generic services account for grouped Service Applications
  • Domain user account
SVC_SPSvcPoolApplication Pool Identity for SharePoint Web Services Default application
  • Domain user account
SVC_SPWebApplication Pool Identity for the main web application
  • Domain user account
SVC_SPUPAThe User Profile Service account is used to run the following:
  • User Profile Synchronisation with AD
  • Domain user account
  • AD Delegate rights for: Replication Directory Changes
SVC_SPSearchThis is the Windows Service account for the SharePoint Server Search Service. This setting affects all Search Service Applications in the farm.
  • Domain user account
SVC_SPSrchPlSearch Admin Web Service application pool
Search Query and Site Settings Web Service application pool
  • Domain user account
SVC_SPSrchCrlWindows user credentials for the Search service application to use to access content when crawling
  • Domain user account
SVC_SPFabricAppFabric Caching service
  • Domain user account
SVC_SPOWAPoolOffice Web App Application pool account
  • Domain user account
SVC_SPOWASvcOffice web application Services Pool
  • Domain user account
SVC_SPSecStrSecure Store application Pool account
  • Domain user account

Prerequisites

  1. All SharePoint servers would require an additional drive to host Data, Log and Index flies.
    1. An additional VHD is required
    2. Bring the disk online
    3. Format the drive as NTFS, label: Data
  1. Ensure that the following are implemented:
    1. Remote Registry Service started (or Automatic - Trigger Start) on all servers
    2. Inbound firewall rules enabled on all SharePoint servers: (Please see SharePoint 2013 Ports, Proxies and Protocols - An Overview of Farm Communications for more information)
      1. ICMP v4
      2. ICMP v6
      3. Central Administration port number on the servers hosting the Central Admin Site only. It is recommend to use SSL for the central administration site.
      4. Distribution Cache port 22233 on the Distribution Cache Servers only
  2. Ensure that the Install account has SQL securityadmin and dbcreator roles and is member of local administrator group on all SharePoint servers
  3. Ensure that the Farm account is a member of local administrators group on the server hosting the User Profile Service Synchronisation Service. This is only required during the User Profile Synchronisation Configuration defined in post #3 User Profile, Search and Distributed Cache Service Applications Deployment. These permissions are only required while configuring User Profile synchronisation Settings. However, when a backup of the User Profile application is initiated, the synchronization service provisions the User Profile application again. During the course of provisioning the User Profile application, the farm account must stop and start the synchronization service. To do this, the farm account must be a member of the Administrators group on the computer that is running the synchronization service.
  1. Ensure that the Farm account is able to logon locally on the server hosting the User Profile Service Synchronisation Service (Please see Plan account permissions).
 Now we are ready to implement SharePoint and configure the basic services. Look out for part two for detailed step by step scripted deployment and configuration of the farm.