I've seen a few people asking how to do things like add MP4 support, WM Connector V2 support or even just the media management features of Windows Media V11 to Home Server.  Some 3rd party devices only support WM Connector V2 and some people want to do things like stream MP4 files to their Xbox 360.  From two articles on the connect forum come the details:

I've done some fiddling today and managed to get this working, albeit in a completely unsupported and at-your-own-risk way.
Ready for some tinkering? After reading up on various workarounds online, here's what I did:
To install Media Player 11:

1. Download wmp11-windowsxp-x86-enu.exe
2. Open this file in an extraction program such as WinZip or 7-Zip (I used 7-Zip)
3. Extract the wmfdist11.exe and wmp11.exe and place them in separate folders on the C: drive of your WHS (not on a share). (this step was adapted from instructions I was following elsewhere - I'm not certain of the separate folders requirement, but I did it anyway)
4. From the WHS admin desktop, right-click the wmfdist11.exe file and click properties.
5. Go to the Compatibility tab and ticket the "Run this program in compatibility mode for:" box, and sleect Windows XP from the drop down.
6. Click OK, and run the wmfdisk11.exe. Choose not to restart at the end.
7. Repeat 4-7 for the wmp11.exe
8. Reboot WHS, launch your newly installed Media player 11.

Now, that doesn't alter your Media Sharing setup at all. If you had Media Sharing turned on before, it will still be using Windows Media Connect 2.0 as included with WHS. So, to set up the newer sharing system:

1. Open the WHS Console, go to Settings, and turn off Media Sharing
2. (This step is possibly optional, but I had to do it)
   1. Click Start, right-click on My Computer, and click Manage.
   2. Browse to Services and Application > Services
   3. Find Windows Media Connect Service, right click it and click Properties
   4. Click Stop (if it is not already stopped)
   5. Set Startup type to Disabled (if not already)
   6. Click OK.
3. Open Windows Media Player on WHS.
4. Click the down arrow on the Library tab and click More Options
5. Click the Monitor Folders button
6. Add D:\shares\Music (or wherever your music is) to the list. NOTE: Microsoft recommend you always use the \\servername\sharename method to access files on the shares, but WMP11 will not share files located on a UNC path without a lot of fiddling around (see "Q. Why can't I play files that are shared by one computer but located on different computer?" on http://www.microsoft.com/windows/windowsmedia/player/faq/sharing.mspx). This worked for me, and given that I'm only reading data using this method and not writing, I don't see the harm - if someone knows differently please tell me!
7. Click OK and wait for files to be added to the library
8. Now click the Configure Sharing button
9. Tick the "Share my media to:" box and configure the settings how you want them by either clicking the Settings button to setup default settings for all devices, or click Configure for each detected client and set each client up manually.
10. Click OK, OK, and close Windows Media Player
11. Start your client of choice and relax.

UPDATE: If you find after following these steps that the Remote Access web page is throing an ASP.NET error (as I did), simply reboot WHS. This seems to be caused by stopping the Windows Media Connect Service.

Remember, this is completely at your own risk and your WHS may explode, lose all your data, and shave your cat for all I know. It worked fine for me, but if you break your server doing this then remember it's your server, and you did it. As Obi-Wan said: "Who's the more foolish; the fool, or the fool who follows him?"

Re: Media Player 11 not supported - Windows Home Server

To then add MP4 support, you need to follow these additional instructions:

In order for WMP11 to stream MP4 video to the XBox it needs to appear in the WMP video library. 

If you install a MP4 DShow filter like 3ivx MPEG-4 5.0.1 Decoder ($7) from p://store.3ivx.com/3ivxStore/product_details.php?id=11 then MP4 video will be shown in the WMP11 video library and then you can stream it to the XBox360.

I now have this working on WHS, sweet!!!

Roger

How to install WMP11 or Zune software on WHS? - Windows Home Server

I hope you enjoy Windows Home Server and connecting it to other devices - I certainly do :-)

ttfn

David