Tài liệu IModule 4: Troubleshooting the Recovery Storage Group pdf

Contents Module 4: Troubleshooting the Recovery Storage Group Introduction What is the Recovery Storage Group? Creating a Recovery Storage Group .7 Adding a Mailbox Store to the Recovery Storage Group .10 Active Directory Attributes 17 Lab 4.1: Create a Recovery Storage Group and review the Active Directory attributes 20 Overriding the Recovery Storage Group .25 Restoring the data 27 Recovering Exchange 2000 Server Mailbox Stores 33 Exmerge 35 Known issues with Exmerge .48 Exercise 2: Recovery Storage Group Scenario 50 Exercise 3: Recovery Storage Group Scenario 54 Details for Exercise 3: Disaster recovery after a Store Crash using the Recovery Storage Group .55 Acknowledgments .58 Information in this document, including URL and other Internet Web site references, is subject to change without notice Unless otherwise noted, the example companies, organizations, products, domain names, e-mail addresses, logos, people, places, and events depicted herein are fictitious, and no association with any real company, organization, product, domain name, e-mail address, logo, person, place or event is intended or should be inferred Complying with all applicable copyright laws is the responsibility of the user Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation Microsoft may have patents, patent applications, trademarks, copyrights, or other intellectual property rights covering subject matter in this document Except as expressly provided in any written license agreement from Microsoft, the furnishing of this document does not give you any license to these patents, trademarks, copyrights, or other intellectual property  2003 Microsoft Corporation All rights reserved Microsoft, MS-DOS, Windows, Windows NT, Active Directory, ActiveX, Excel, Exchange Server 5.5, Exchange 2000 Server, Exchange Server 2003, Internet Explorer, Internet Information Server, Word are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries The names of actual companies and products mentioned herein (Groupwise, Lotus cc:Mail, Lotus Notes) may be the trademarks of their respective owners Module 4: Troubleshooting the Recovery Storage Group Introduction In this session we will look at the Recovery Storage Group in Exchange Server 2003 The Recovery Storage Group is a new type of Storage Group in Exchange Server 2003 which is designed to facilitate the recovery of Mailbox Store data without the need for an alternate Active Directory forest for recovery In Exchange 2000 Server, we required the use of an alternate Active Directory forest/Exchange org to recover data without affecting the production environment The Recovery Storage Group is designed to simplify the data recovery process and lower the TCO for customers by eliminating the need for hardware for an alternate recovery forest The Recovery Storage Group allows us to restore production Mailbox Stores to live servers Once the restore has been performed, we can use Exmerge to merge the data back into the live stores We will look at the process of recovering data and also the sort of issues we can run into and how to solve them Module 4: Troubleshooting the Recovery Storage Group Mailbox Recovery in Exchange 2000 Server Exchange 2000 Server required the use of a separate Active Directory forest in order to restore databases and recover mail items without affecting the production system in any way A typical recovery scenario would be: A server crashes and a mailbox store cannot be mounted The transaction logs are still available After unsuccessfully attempting to get the store to mount, the administrator would take copies of any log files and database files from the time of the crash and then mount blank databases so that the users could log in and send/receive mail A separate Active Directory forest would then have to be set up and a new Exchange organization would have to be created in this forest The following information must remain consistent with the production environment: Exchange Organization Name Administrative Group Name Storage Group Name Logical Database Name LegacyExchangeDN The administrator must also ensure that the Operating System and Exchange have the same service packs and hot fixes as the production machines When the administrator has done this, he could start the restore of the databases to this recovery server Once the restore was complete and any log files have been replayed, the database would be at a consistent state The administrator would then use a utility like Exmerge to export the data to pst files and then import it into the live database The option of switching the recovered databases from the alternate forest with the blank databases in production is also available This will reduce the amount of time required to Exmerge data back to the production server This is obviously a fairly long process and in larger environments, it meant that customers would have to maintain a separate Active Directory forest for this purpose The recovery steps for Exchange 2000 Server are explained in 813337.KB.ENUS A Microsoft Support Webcast goes into great detail on this subject: Support Webcast: Microsoft Exchange 2000 Alternate Server Data Recovery http://support.microsoft.com/default.aspx?scid=kb;enus;811063&gssnb=1 Module 4: Troubleshooting the Recovery Storage Group What is the Recovery Storage Group? The Recovery Storage Group is a new type of Storage Group that can be created on servers running Exchange Server 2003 in order to facilitate Mailbox data recovery An existing Mailbox Store can be added to a Recovery Storage Group and then recovered while the original database is still online Note The Mailbox store is not physically added to the Recovery Storage Group A placeholder object is created in the Recovery Storage Group that is used as a reference back to the original Mailbox Store We will look at this in more detail later Exmerge is then used to merge the recovered information over to the production Mailbox Store A Recovery Storage Group can be created on both Standard and Enterprise editions of Exchange Server 2003 Recovery Storage Groups will work irrespective of the Operating System that Exchange Server 2003 is installed on Restrictions and criteria Recovery Storage Group has the following restrictions/criteria: One Recovery Storage Group per server can be created Five Mailbox Stores can be added to the Recovery Storage Group Only mailbox stores from the same Admin Group can be added to the Recovery Storage Group Once a mailbox store has been added, only mailbox stores from the same original Storage Group can be added to the Recovery Storage Group An Exchange 2000 Server mailbox store can also be added to an Recovery Storage Group but it must be a minimum of SP3 Module 4: Troubleshooting the Recovery Storage Group In order to add a Mailbox Store to the Recovery Storage Group it must exist in the Active Directory All restores will default to Mailbox Stores that are in the Recovery Storage Group, not to the live database (Note: The backup client must be pointed to the server hosting the Recovery Storage Group) There is a registry key to override this behaviour (“Recovery SG Override”) (See Section 7) Mailbox Stores in the Recovery Storage Group not mount on startup/failover By default the “This database can be overwritten by a restore” is checked on recovery databases Public Folder Stores cannot be added to a Recovery Storage Group New Mailbox Stores cannot be created in a Recovery Storage Group When the Mailbox Store is mounted, all mailboxes remain disconnected and cannot be reconnected No new mailboxes can be created on a recovery database MAPI is the only protocol that is supported When the Mailbox Store in the Recovery Storage Group is mounted, you will receive a warning (prompt) The log file prefix for the Recovery Storage Group is Rnn On an Active/Active cluster (2 Node) we can create one Recovery Storage Group per cluster On an Active/Passive cluster we can create one Recovery Storage Group per Exchange Virtual Server (EVS) Mailbox Stores from standalone servers can be added to an Recovery Storage Group on a clusters and vice versa provided they are in the same Administrative Group No online maintenance will be run on recovery databases System and Mailbox policies are not applied to recovery databases Recovery Storage Groups cannot be renamed Recovery Databases cannot be backed up In order to successfully Exmerge out the data for a particular user, their mailbox must exist on the same mailbox store as of the time of backup Note To recover Public Folder databases, the alternate forest method is still required Module 4: Troubleshooting the Recovery Storage Group Recovery Storage Group uses There are two key scenarios where the Recovery Storage Group is useful The first occurs when we need to recover a certain number of mail items without affecting the production environment This may be an important piece of mail for a CEO or a mailbox that was removed due to an administrative error The second scenario occurs when we run into a critical problem with the production mailbox stores A customer’s Mailbox Store or a particular log file may become corrupted, which results in a store that will not mount A Service License Agreement may dictate that after a certain number of hours users must be able to send/receive mail In this situation the Administrator would probably move out all databases and log files and then mount blank databases The recovery of mail data could then begin offline The two most common scenarios can be broken down as follows: Recover Mail items for a particular user A user contacts the IT helpdesk and needs a piece of data recovered that they deleted from their mailbox The item is not available in the dumpster The Administrator will then use the following steps to recover the mail item using a Recovery Storage Group: Create a Recovery Storage Group on any server in the Admin Group Add the mailbox store to the Recovery Storage Group Restore the data to the Recovery Storage Group server and mount the Mailbox Store Use Exmerge to export the data and then to import it directly into the user’s mailbox Dismount and delete Mailbox Store in the Recovery Storage Group Delete the Recovery Storage Group Mount blank Mailbox Stores due to corrupt store The steps to recover in this manner are as follows: Mailbox Store becomes corrupted and cannot be mounted Move out all log files (assuming no other databases are mounted in the storage group) and the corrupted database files Mount blank databases Users can log in and send/receive mail Create a Recovery Storage Group on any server in the same Admin Group Restore a backup of the Mailbox Store to the Recovery Storage Group server If you wish to replay any log files you must place them in the Transaction Log Path of the Recovery Storage Group When you initiate a hard recovery of the mailbox store, it will start replaying log files from the backup set (usually from a path that is specified at the time of restore) and then continue replaying log files from the Transaction Log Path When the mailbox store has been recovered, we are ready to switch it back to live storage group Dismount the Mailbox Store in the Recovery Storage Group and the Mailbox Store in the live Storage Group Switch the databases with each other and then remount them again Module 4: Troubleshooting the Recovery Storage Group We then use Exmerge to export/import the new data from the clean databases we created When the Exmerge is finished, dismount and delete the mailbox store in the Recovery Storage Group Delete the Recovery Storage Group The reason for switching the databases with each other is so that we Exmerge the minimum amount of data The blank mailbox stores will hold a relatively small amount of data compared to the live mailbox store so it makes sense to only Exmerge this data This is, of course, a matter of preference and there is nothing to stop you Exmerging over the larger amount of data to the new databases Remember that when Exmerging large amount of data, lots of transaction logs are generated so there must be sufficient disk space on the server Module 4: Troubleshooting the Recovery Storage Group Creating a Recovery Storage Group Using Exchange Server 2003 System Manager we now have a new choice when creating Storage Groups on an Exchange 2003 server As well as normal Storage Groups, we can now create Recovery Storage Groups The steps to create a Recovery Storage Group are as follows: Right-click on the chosen server object in Exchange System Manager and choose New – Recovery Storage Group Module 4: Troubleshooting the Recovery Storage Group The Recovery Storage Group Properties sheet will now be displayed Here we can specify a name for the Recovery Storage Group It is a good idea to use a name that clearly identifies it as a Recovery Storage Group as the icon in Exchange System Manager for a Recovery Storage Group and a normal Storage Group are the same The Recovery Storage Group must have a unique name on the server It cannot have the same name as a normal Storage Group that is already in use on the server The name of the Recovery Storage Group does not have to match the name of the Storage Group that hosted the Mailbox Store that we are about to restore Specify the Transaction log location and the System Path Location using the browse buttons This location cannot be changed afterwards The Transaction log location and System path location should NOT be set to the same as an existing Storage Group on the Exchange 2003 server To try and simplify the whole process, use the same paths for the transaction logs, system path and database files As almost no data is written to Mailbox Stores mounted in a Recovery Storage Group, there will be very few transaction logs generated Therefore, there is no real performance gain by splitting the transaction logs and database files onto separate drives (This is contrary to normal best practices regarding normal Storage Groups in Exchange 2000 Server and Exchange Server 2003) 44 Module 4: Troubleshooting the Recovery Storage Group Choose Step 2: Import the data Select the database that we are going to import the data into Notice that Recovery Storage Groups are not visible when importing data Module 4: Troubleshooting the Recovery Storage Group Choose the desired mailboxes and then click Next Choose the correct locale and click Next 45 46 Module 4: Troubleshooting the Recovery Storage Group Choose the directory that contains the pst files and then click Next Click on the Save Settings button and then click Next Module 4: Troubleshooting the Recovery Storage Group 47 The import process completed successfully If you have any issues during the import process,s then Exmerge will display as follows: In this situation, the first place to check is the Exmerge.log file The log file will offer more detailed information on what went wrong The most common error here is incorrect permissions Check the security on the target mailbox store and try the import again 48 Module 4: Troubleshooting the Recovery Storage Group Known issues with Exmerge An issue you may run into when trying to extract data from a Recovery Storage Group using Exmerge is when Exmerge cannot match the Mailbox GUID from the database with a user object in the Active Directory The following error will be shown during the extraction phase: In the Exmerge log file, we will see the following: [22:55:33] Error! Cannot identify the user with the msExchMailboxGuid \2F\7B\BD\86U\C7\5CJ\9F\20\BB\24\93\EB\10\08 The legacyExchangeDN is /O=X-FOREST/OU=FIRST ADMINISTRATIVE GROUP/CN=RECIPIENTS/CN=USERY There a couple of reasons we may see this error: The user account has been deleted from Active Directory If the user account is deleted, then Exmerge will obviously not be able to match the Mailbox GUID from the database to an Active Directory object You will therefore not be able to extract information from this mailbox using Exmerge The user’s mailbox has been moved to another Mailbox Store When a user’s mailbox is moved, it effectively creates a new mailbox in the target store, moves the data, and then deletes the original mailbox This will result in the user getting a new Mailbox GUID Exmerge will not be able to match the Mailbox GUID in the database to a Mailbox GUID in Active Directory Module 4: Troubleshooting the Recovery Storage Group 49 There are a couple of workarounds to allow us to get the data from the mailboxes in this scenario The first workaround is to perform a “victim restore” of the mailbox store to another Exchange 2003 server in the same Admin Group Once the mailbox store has been successfully restored to another server, we can then reconnect the required mailboxes to Active Directory objects and then use Exmerge to extract the data See the following article for a more detailed look at the process: 324127 XADM: How to Restore an Information Store Database to a Server That Resides in the Same Active Directory Forest http://support.microsoft.com/?id=324127 The second workaround would be implemented if the customer has already performed the restore of the data using a Recovery Storage Group Let us assume the customer has restored a fairly large database in order to recover some data from a mailbox that has since been deleted The customer then discovers that he cannot Exmerge out the data due to the Mailbox GUID mismatch problem We really not want to tell the customer to perform a new “victim restore” as that will obviously take a fair amount of time We have the mailbox store in the Recovery Storage Group and it should be consistent We can create a new Storage Group on the Exchange 2003 server and then create a Mailbox Store in this Storage Group Make sure that the Mailbox Store that is created has the same database names as our restored Recovery Database We can then move the database files from the Recovery Storage Group into the Storage Group, mount the mailbox store, reconnect the necessary mailboxes and Exmerge out the data 50 Module 4: Troubleshooting the Recovery Storage Group Exercise 2: Recovery Storage Group Scenario Overview of Exercise User1 needs a piece of mail or their entire mailbox recovered Create a Recovery Storage Group on any server in the Admin Group AG1 Add Mailbox Store MBX1 to Recovery Storage Group Start backup client and restore valid backup of MBX1 (The backup client will need to be pointed to the server containing the Recovery Storage Group) Check the ”Last Backup Set” as appropriate Mount MBX1 in the Recovery Storage Group (All users appear as disconnected.) Exmerge out User1’s data (from Recovery Storage Group to PST) Exmerge in User1’s data (from PST to live Mailbox Store) Done Dismount and delete MBX1 in the Recovery Storage Group Delete the Recovery Storage Group Objective: To recover a single mail item using a Recovery Storage Group Exercise Detailed Steps SERVERS: Z2 has Exchange Server 2000 SP3/domain controller (power this one completely before other virtual machines) Z3 has Exchange Server 2003 Username: Administrator Password: Password1 Module 4: Troubleshooting the Recovery Storage Group 51 Log into the Z3 server using the above credentials Start Active Directory Users and Computers on Z2 Drill down to the Users container Create a new user in this container Username: exercise2 Choose a password that meets the complexity requirements Uncheck User must change password at next logon Click Next Create a mailbox on ORG/Hubsite/Z2/First Storage Group/Mailbox Store(Z2) (Note that you are not selecting the default store.) Click Next and then Finish Wait for the Recipient Update Service to stamp a proxy address on the user object Start Internet Explorer and go to the following location: http://Z2/exchange/exercise2 Log in using the credentials MS\exercise2 and the password you chose in step Create a new mail item Address it to the recipient Exercise2 In the subject line type IMPORTANT Set the mail as high importance 10 The mail should now be in your Inbox 11 We are now going to make a backup of the Mailbox Store Click on Start, then Run Type Ntbackup in the field and click OK 12 Choose the Backup tab Drill down to Microsoft Exchange Server - Z2 - Microsoft Information Store - First Storage Group and check First Storage Group 13 Set the backup media or filename to c:\exercise2.bkf and click Start Backup 14 The Backup Job Information page appears Click Start Backup 15 When the backup is complete, click Close 16 Go back to the Exercise2 mailbox in Outlook Web Access Right-click on the mail IMPORTANT and choose delete 17 Right-click the Deleted Items Folder and choose Empty Deleted Items Click OK to confirm 18 Click on the Recover Deleted Items icon on the right-hand pane and then choose Permanently Delete Click OK to confirm 19 Close the Delete Items dialog box The mail has been completely deleted now 20 Create some new mail items addressed to Exercise2 21 Using Exchange System Manager we are now going to create an Recovery Storage Group in order to recover this mail item 22 Start Exchange System Manager on Z3 Create a new Recovery Storage Group on Z3, but then add the Mailbox Store (Z2) to this Recovery Storage Group Note that a window appears, which warns that any restored Exchange 2000 Server SP3 databases will be upgraded to Exchange Server 2003’s engine if mounted in the Recovery Storage Group Proceed by clicking OK 23 When the Mailbox Store has been added to the Recovery Storage Group, we can now perform the restore 52 Module 4: Troubleshooting the Recovery Storage Group 24 Go back to NTBACKUP and choose the Restore tab 25 In the left-hand pane, expand the following: File - Media Created Z2\Microsoft Information Store\First Storage Group 26 Select checkboxes on all databases in the First Storage Group 27 Click on Start Restore 28 Make sure the ‘Restore to’ is set to Z3 Set the Temporary location for log and patch files to c:\templogs Check the Last Backup Set checkbox Then click OK, and then OK again (Note: If it says “unable to create logfiles,” be sure to remove the UNC prefix before the server name, then retry.) 29 The restore will now begin When the restore is complete, you should see that it completed with errors 30 Review the 9635 error in the applog It clues you in on the fact that the public folder store is not present in Active Directory, underneath the Recovery Storage Group (This is due to the fact that only mailbox stores may be added to Recovery Storage Groups.) 31 Repeat Steps 24-28, but modify step 26 by selecting ONLY the checkboxes for ‘Log Files’ and ‘Mailbox Store(Z2)’ 32 Restore should now work Review the report to confirm that there are no errors, and then close ntbackup 33 Open an Explorer Window and drill down to the location you specified for your Recovery Storage Group (it will usually be c:\program files\exchsrvr\recovery storage group) 34 Notice that the files have now been restored to this location 35 Go to Exchange System Manager and go to the properties of the Recovery Storage Group’s mailbox store 36 Go to the Databases tab, and select “This database can be overwritten by a restore.” (Note: This step would not be necessary if you had not failed the partial restore and received errors in step 29.) 37 Mount the Mailbox Store in the Recovery Storage Group Click Yes to the warning Click OK when the store has mounted 38 Drill down to the Mailboxes node under the Mailbox Store (You may need to refresh the view) Notice that all mailboxes are disconnected, and that you cannot use “Exchange Tasks” upon them 39 Copy Exmerge.exe and Exmerge.ini from the lab location (or mounted ISO image) into the c:\program files\exchsrvr\bin folder Ask your instructor if you cannot locate the ISO image Alternatively, if you have access to the internet from the virtual machine, navigate to www.microsoft.com/exchange, go to Downloads, and then Tools, and then you can download the Exchange Server 2003 version of Exmerge from there 40 Create a folder called c:\exmerge on z3 This will be used to hold the pst file(s) 41 In Exchange Server 2003, by default the Administrator account, Domain Admins and Enterprise Admins have an inherited Allow and Deny on Receive As and Send as for Mailbox Stores This is an effective Deny We need to remove this in order to be able to log in to Exercise2 mailbox and import the mail item Module 4: Troubleshooting the Recovery Storage Group 53 42 Use Exchange System Manager and drill down to the server Z2 Take properties on the Mailbox Store(Z2) and select the Security tab 43 Click on the Advanced tab and uncheck the Allow Inheritable permissions checkbox 44 Click Copy and then OK and then Yes 45 For Administrator, Domain Admins and Enterprise Admins, make sure that they have only Allow checked for Receive As and Send As Click Apply and then OK 46 We are now ready to recover the mail item using Exmerge Start Exmerge.exe from the bin folder 47 Click Next 48 Choose Extract and Import (One Step Procedure) and click Next 49 For the Exchange Server name, type Z3 (this is the server with the Recovery Storage Group) and type Z2 for the domain controller 50 Click the Options button 51 Accept the default settings on the Data tab 52 Click the Message Details tab In the Enter new message subject tab type IMPORTANT and then click Add Then click OK 53 Click Next 54 In the Destination Exchange Server, type Z2 and click Next 55 Choose the Recovery Storage Group/Mailbox Store (Z2) and click Next (Note: You will not get the Recovery Storage Group option with previous versions of Exmerge.) 56 Select the ‘Exercise2’ mailbox and then click Next 57 Click Next to accept the default locale 58 Select the folder c:\exmerge and click Next 59 Click Next to start the import 60 Click Finish 61 Go to the Exercise2 mailbox in Outlook Web Access and the mail item IMPORTANT should be back in place 62 We can now dismount and delete the Recovery Storage Group mailbox store Use Exchange System Manager to dismount the Mailbox Store in the Recovery Storage Group Then delete the Mailbox Store 63 Then Delete the Recovery Storage Group from Exchange System Manager 64 Delete the directory c:\program files\exchsrvr\recovery storage group 65 We now have to reset the permissions on the live mailbox Store Locate the Store, select Properties and then choose the Security tab 66 For Administrator, Domain Admins and Enterprise Admins check both the Allow and Deny checkboxes for Receive As and Send As 67 Then check the “Allow inheritable permissions” checkbox 68 Click Apply You will receive a warning that the properties will not be visible until the next time you open it Click OK and then OK again 54 Module 4: Troubleshooting the Recovery Storage Group Exercise 3: Recovery Storage Group Scenario Objective: To simulate a store crash, and recover an entire Mailbox Store while allowing users to send/receive e-mail using a “dialtone” (temporary empty swap) database Overview of Scenario Recovery Storage Group Restore MBX store1 becomes corrupted and will not mount Log files are intact Other databases in the Storage Group are okay Move out corrupted databases and mount blank (dialtone) databases Users can log in and start working immediately OST files are destroyed (since their keys were in the corrupted DB) Presently, there is workitem in Outlook 2003 to stop this from happening and redirect user to OWA instead, but these are just plans and not final Create an Recovery Storage Group on any server in the same AG and add MBX1 to it Copy over required log files from original server to the Recovery Storage Group Start backup client and restore valid backup of MBX1 (The backup client will need to be pointed to the server containing the Recovery Storage Group) Check the ”Last Backup Set” as appropriate Mount MBX1 in the Recovery Storage Group All users appear as disconnected Dismount both copies of MBX1 Both databases will be set as ”Clean Shutdown” Switch the databases with each other and remount them Old OST keys now recovered Exmerge over the restored data to the live database 10 Exmerge the ”new” data from the Recovery Storage Group MBX1 (previous dialtone) back into the recovered MBX1 This should be relatively little data 11.Done Dismount and delete MBX1 from the Recovery Storage Group Module 4: Troubleshooting the Recovery Storage Group 55 Details for Exercise 3: Disaster recovery after a Store Crash using the Recovery Storage Group Setup SERVERS: Z2 has Exchange 2000 SP3 Server/DC Z3 has Exchange 2003 Server Username: Administrator Password: Password1 Log into Z3 using the credentials above and start ESM Start ADUC and create a user called Ex3user Give the user a password that meets the complexity requirements and create a mailbox on Z3 Log in to the Ex3user mailbox using the url http://Z3/exchange/ Ex3user Create a mail and address it to your self In the subject put "Pre Crash" Attach the file c:\Exchange Server Setup Progress.log and send it The mail should now be in your Inbox We are now going to backup the Mailbox Store Start NTBackup (Start - Run - NTBACKUP) Click on the backup tab Drill down to Microsoft Exchange Server - Z3 - Microsoft Information Store - First Storage Group Select the entire storage group and specify the file c:\precrash.bkf (Note: If you still see “Recovery Storage Group” then you will need to restart NTBackup) Click on the Start Backup button and once more to confirm When the backup has completed go back to the Ex3user mailbox in OWA Create a new mail to Ex3user and in the subject type "Pre Crash - Post Backup" Again attach the progress log When this is done click on Send 10 We are now going to simulate a Store crash Open a command prompt and type the command TLIST 11 Note the PID of the Store.exe process 12 In the command prompt type the following command: "kill PID /f" without the quotes (where PID is the PID of the Store process) The Store process should now be killed 13 Normally when we try to start the Information Store process a soft recovery will be initiated We will assume that the Mailbox Store cannot be mounted We will then mount a blank mailbox store for Ex3user to log in and work 14 Open ESM and drill down to the First Storage Group Take properties on the Mailbox Store and set it to "Do not mount at startup" on the database tab 56 Module 4: Troubleshooting the Recovery Storage Group 15 Repeat the previous step, but except change it on the Public Folder Store We will assume that the customer does not care for immediate public folder access, so we will not cover this as the pub may be repaired on another server, or on the same server at a later time 16 Open an explorer and drill down to c:\program files\exchsrvr\mdbdata Move all the files (except for pub.edb & pub.stm) to c:\temp (create the folder if necessary) 17 Start the Information Store service using the command "net start msexchangeis" 18 Go to ESM and mount the Mailbox Store You will be warned that one of the database files is missing Click Yes to accept this 19 Go back to Ex3user’s mailbox and confirm that the mailbox is empty 20 Create a new mail item, address it to Ex3user and attach the progress log file(s) again In the subject type "Post Crash - Blank Store" 21 At this point our user can send and receive mail For the next steps, we must create an Recovery Storage Group, restore from our backup set and also replay any log files that we moved in to c:\temp 22 Using ESM create an Recovery Storage Group on the server and add the Mailbox Store(Z3) to it 23 Go to c:\temp and copy the following files into "c:\program files\exchsrvr\Recovery Storage Group": E00.log & any other log file from the E00xxxxxx.log range (Do not move Res1.log and res2.log They are not required) 24 Start NTBACKUP and choose the restore tab 25 Drill down through the media we created in the earlier step Select the Mailbox Store and the Log Files only 26 Click on Start Restore 27 Leave the Restore To: field as default Specify c:\templogs as the temporary location As we want to perform a hard recovery afterwards we should check the Last Backup Set 28 Click OK to start the restore Click OK again to confirm After the restore is complete it may take a while before hard recovery completes successfully 29 Look in the Application Log for an ESE 902 event This signifies that the hard recovery succeeded 30 The Mailbox Store in the Recovery Storage Group is now at a consistent state 31 We are now going to dismount the live Mailbox Store and switch the database files with each other 32 Go to ESM and dismount the nearly-empty Mailbox Store 33 Open an explorer and drill down to c:\program files\exchsrvr\mdbdata 34 Move priv.edb & priv.stm to a temporary location (Perhaps a new directory named something like c:\cleanshutdown-almostempty) 35 Move the files "Mailbox Store (Z3).edb & stm from c:\program files\exchsrvr\Recovery Storage Group to c:\program files\exchsrvr\mdbdata (Notice that the database names are not the same by default) Module 4: Troubleshooting the Recovery Storage Group 57 36 Once the files are in the mdbdata folder we need to rename them back to priv1.edb & priv1.stm 37 Use ESM and take properties on the live Mailbox Store On the database tab check the "This database can be overwritten by a restore" 38 We can now mount the Mailbox Store 39 The Ex3user user should now be able to see the mail items prior to the crash in his mailbox 40 The Post crash mail should not be visible 41 We now have to move the database files from the temporary location (created in step 34) into c:\program files\exchsrvr\Recovery Storage Group 42 Clean-up any other residual files in the Recovery Storage Group directory so that only the EDB and STM remain 43 Rename the edb and stm to the names expected by the non-Recovery Storage Group store object in AD (Typically Mailbox Store (Z3).edb & stm) 44 We can now mount the Mailbox Store in the Recovery Storage Group 45 The Mailbox Store in the Recovery Storage Group is now mounted We will now use Exmerge to merge over the post crash data into the live store 46 Use the same steps as outlined in Scenario to use Exmerge out the data from the Recovery Storage Group to the live store 47 When you are done, dismount and delete the Recovery Storage Group 58 Module 4: Troubleshooting the Recovery Storage Group Acknowledgments Microsoft Employee Simon Walsh Michael Lee ... recover the mail item using a Recovery Storage Group: Create a Recovery Storage Group on any server in the Admin Group Add the mailbox store to the Recovery Storage Group Restore the data to the Recovery. .. the Recovery Storage Group and the Mailbox Store in the live Storage Group Switch the databases with each other and then remount them again 6 Module 4: Troubleshooting the Recovery Storage Group. .. manage a Recovery Storage Group Module 4: Troubleshooting the Recovery Storage Group 11 12 Module 4: Troubleshooting the Recovery Storage Group The Select database to recover dialog box will then