Thursday, September 29, 2005

Link-based IPMP on Solaris 10

I have been setting up IPMP on a Solaris 10 server today and as it has been a while since I'd done this I thought I should have a look over the IPMP documentation and see what has changed.

Previously in an active-standby configuration you would use probe-based detection which required the setup of a test address for the standby interface and the failover detection would be performed by in.mpathd sending icmp traffic using the test address.

I have never liked having to assign an extra address just for the failure detection as you end up wasting a lot of addresses if you have a lot of servers with IPMP on a subnet. Also as they usually aren't put in DNS there is a risk of someone assigning a new server with the same address. The configuration for probe-based detection is pretty messy with lines like the following being inserted into the hostname files.

addif 192.168.85.21 netmask + broadcast + -failover deprecated up

However if you are running Solaris 10 and you have a NIC that supports it you can use link-based IPMP. Link-based failure detection works by the NIC driver monitoring the link state and notifying the network subsystem in case of a failure.

The great thing about this is it does not need a test address and the setup of IPMP is very simple. For example if I have two interfaces (qfe0 and qfe4) that I want to operate in a active-standby configuration, all that would need to be done is create the two files below in /etc.

hostname.qfe0
hostname group groupname up

hostname.qfe4
group groupname up

That's it! Now you have failover for all IP addresses, including virtual, on qfe0. Also if you have zones set up with qfe0 as a physical interface the zone's IP addresses will now also failover.

35 Comments:

Anonymous Anonymous said...

"However if you are running Solaris 10 and you have a NIC that supports it you can use link-based IPMP"

The problem is that in practice, link based detection works only on SUNW NICs.

For example, I could not get IPMP to do link based failure detection and failover in my ASUS P4 server, which has onboard Broadcom GigE (bge) NICs. It simply doesn't work, in spite of the fact that the driver reports that the link is down!

The point I'm trying to make: I've got two $9 RTL8139D NICs running in my 220R. The times of expensive, built-for-SPARC-PCI adapters are going buh-bye. x86/x64 arena makes this even more obvious: most NICs in machines nowdays are going to be commodity parts. And most drivers for those NICs still don't play well enough with IPMP to support NIC based failure detection and subsequent failover.

It's still a problem didn't go away.

3:55 AM  
Anonymous Anonymous said...

Even though this is a great feature and I am sure a lot of companies will switch to link-based IPMP, there is one small problem. In the majority of my installations we've had redundant switches and routers and, should a switch further down the line choke IPMP would never know and still continue to send data down that path.
Of course, this can be solved on the network but due to design you may not want to.

Anyway, I'm not saying link-based IPMP is in anyway unusable, just saying that it's not for everyone :)

- Lasse

2:40 AM  
Anonymous Anonymous said...

Shanon,

Nice idea and it does cut down on those ICMP requests. However, link based really does suck. We've had problems in our HP ServiceGuard environments because Link monitoring is the only option available and there have been times when the Link has been up and the connection has been dead.

Examples:

1. Fibre link failed, media converter keeps the 100Base-T side up and no failover is generated.

2. Backhaul to switch fails. 50% of packets fall into abyss because host still sees a link from the switch, but switch is going nowhere. With proper probing, the link would fail and the host would only use the still-working redundant switch.

3. NIC goes faulty. It keeps link up but fails to transmit/recieve any packets. 50% of traffic goes to /dev/null.

-- Andre.

4:16 PM  
Anonymous Anonymous said...

email me Shannon - damian.craig@hotmail.com

1:26 AM  
Anonymous Anonymous said...

Shanon, thanks for the information you have posted, it has been very helpful to me, Thanks again, great work.

9:38 PM  
OpenID dfn-doe said...

Thanks for the simple example, even though this is supported the documentation from Sun doesn't seem to have caught up and only mentions this being available but does not describe the actual configuration.

3:17 PM  
Blogger dghnfgj said...

welcome to the wow power leveling cheap wow power leveling service site,WoW Gold buy cheap wow gold,wotlk gold,world of warcraft power leveling buy wow gold

12:52 AM  
Anonymous Anonymous said...

I just setup IPMP on two NICs and I had to use 4 IP address. I'm running Solaris 10 on a T5120 builtin NICs. I was wondering if any of you got IPMP working without implementing 4 IP address and NOT having link state NICs/drivers. Have you of you use one test IP address with two physical IP addresses assigned to the physical interface? My email address is mawood44@yahoo.com. Thanks in advanced!

3:47 AM  
Anonymous Anonymous said...

Now do you worried about that in the game do not had enough cabal online alz to play the game, now you can not worried, my friend told me a website, in here you can buy a lot cabal alz and only spend a little money, do not hesitate, it was really, in here we had much cabal gold, we can sure that you will get the cabal money, quick to come here to buy cabal alz.

I like play online game, I also buy dofus kamas and kamas, the cheap kamas is very cheap, and use the dofus gold can buy many things, I like dofus kamas, thanks, it is very good.

I like play online game, I also buy isk and eve isk, the eve online isk is very cheap, and use the cheap eve isk can buy many things, I like buy eve online isk, thanks, it is very good.

I like play online game, I also buy fiesta Gold and fiesta Gold, the fiesta money is very cheap, and use the fiesta online gold can buy many things, I like fiesta online money, thanks, it is very good.

7:42 PM  
Anonymous Anonymous said...

aion china,
aion china gold,
aion cn gold,
aion chinese gold,
aion gold china,
aion gold chinese,
china aion gold,
chinese aion gold,
aion china kina,
aion chinese kina,
aion kina china,
china aion kina,
aion china buy,
buy aion china,
aion chinese server gold,
aion cn server gold,
aion china server gold,
china aion server gold,
chinese aion server gold,
aion chinese server gold,
aion cn server kina,
aion china server kina,
china aion server kina,
chinese aion server kina</a

11:31 PM  
Blogger cheap wow gold said...

www.wowgolds.org has the lowest wow gold price in the cheap wow gold market.The store has been dealing with wow gold business for 5 years.Every day thousands of customers come to buy wow gold for its cheaper price.Our store has stored a large number of World of Warcraft Gold. Customers can purchase wow gold of any characters at any time. And we also provide the best services for customers. We can deliver the World of Warcraft Gold in just 30 minutes,and make the whole online transaction of cheap wow gold in only 10 minutes.by edmund chein

11:31 PM  
Blogger 琪琪 said...

who has started the last 12 games in the absence of Yi Jianlian. "I know I've improved a ton defensively this season."
...................................................
.......

12:48 AM  
Blogger 琪琪 said...

you are not our mother. She has a soft, pleasant voice, but your voice is rough, you are the wolf.
...................................................
......

12:49 AM  
Blogger 琪琪 said...

If on the other hand, you need a detailed manual, the instructions are there for you to access.
...........................................................
...

12:51 AM  
Blogger wo said...

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I like it

4:01 AM  
Blogger wo said...

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . good,very good!

4:02 AM  
Blogger wo said...

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . .

This article is very good,I like it !

4:03 AM  
Blogger wo said...

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . good!good!

4:03 AM  
Blogger wo said...

. . . . .
. . . .
. . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
I like it,good,very good!

4:04 AM  
Blogger virstock.com said...

Dofus Kamas|Prix Moins Cher Dofus Kamas|Kamas par allopass|Dofus kamas audiotel|Dofus kamas par telephone sur Virstock.com

Meilleur prix dofus kamas stock de dofus kamas

Prix moins cher dofus kamas
vente dofus kamas sur www.virstock.com

Kamas par allopass sur dofus kamas

Dofus kamas par telephone sur dofus kamas

Dofus kamas audiotel sur dofus kamas

http://www.virstock.com/jsp/comments.jsp dofus kamas vente

http://www.virstock.com

3:15 PM  
Blogger Games, Entertaiment, Hobby, said...

flyff Server Servers Private Top 100

1:01 AM  
Blogger Roxy said...

Costa rica tours, shopping online, costa rica fishing, jaco fishing charters, costa rica whale watching, costa rica dolphin watching, costa rica party boat, panama fishing, fishing costa rica los suenos, los suenos fishing charters, costa rica fishing los suenos, los suenos costa rica fishing, costa rica los suenos fishing, fishing costa rica los suenos, los suenos fishing charters, costa rica fishing los suenos, los suenos costa rica fishing charters, costa rica los suenos fishing, Los suenos fishing, Fishing costa rica los suenos, Costa Rica Rafting,
http://www.kingtours.com/.

1:04 PM  
Blogger King Bayern Munich said...

We supply many styles of sofas,such as living-room-sofa, Modern leather sofa . soft sofa. Lounge-sofa .
e supply all kinds of stone product,such as china tombstones, Modern-stone-sculpture, paving-stone Glazed-Vitrified-Tiles

1:06 AM  
Blogger goldview said...

All kinds of replica handbags,we wholesale wide selection of top designer replica handbags like Juicy Handbags, Jimmy Handbags, Prada Handbags, Burberry Handbags, GUCCI Handbags, Coach Handbags, Louis Vuitton Handbags at the lowest price.

12:55 AM  
Blogger Ephesus said...

I loved every moment of our tour. Istanbul, cappadocia and ephesus are fantastic city. We saw so many historical places and guide was very informative. We definitely recommend it. http://www.packagetoursturkey.com - http://www.touroperatoristanbul.com We visited Istanbul for the first time on your tour turkey tours we are from Cappadocia tours Greece and we just loved it! istanbul tours We finally were able to see sights that we had only heard from istanbul tourism friends who visited I have to say that this trip was fantastic. I had a great time in Turkey. Everything went on very well actually much better than we expected istanbul travel Our guide was very friendly and ephesus tours he knew all details of history. Thanks forerything.

6:06 AM  
Blogger istanbul said...

TTG Travel Agency is a leading travel agency and tour operator in istanbul Turkey with more than seven years of professional travel service. Because of our dedication and commitment to your needs istanbul travel we are able to offer you better quality of service at lower prices than other operators. http://www.istanbulhotels.com We provide hundreds of elaborately pre-designed Turkey tour packages, Turkey tours discounted, Guided turkey hotels and Turkey Tours, and we also provide customized travel service that is organized according to your specific needs and requirements http://www.istanbulhotels.com Our tours are professionally guided, intimate, and safe.

7:33 AM  
Blogger pedro velasquez said...

What are the performance differences between IPMP-P-AS and IPMP-P-AA?
Do some applications fail with an IPMP-P-AA (two IPs plumb)?
Is there a way to setup the Link based IPMP to an active-active mode?dominical costa rica tours

What is the difference between Link- based IPMP and Probe based IPMP?
How does Link-based IPMP compare to the other IPMP modes?
Which of these IPMP setups offers the most bandwidth and stability and
application compatibility?
Besides (nicstat 5) what other tests or tools would you use to test these
setups for Network performance?
http://www.dominicalcostaricatours.com

2:53 PM  
Blogger Vinny said...

Amazing work! The content delivered was very useful. I am hoping that you carry on with the excellent job accomplished.
miami beach locksmith

4:47 AM  
Anonymous hotels in istanbul said...

All Istanbul Hotels: Find the best Istanbul, Taksim hotels, attractions, restaurants, travel agencies, shopping, travel advice and more on http://www.Allistanbulhotels.com

1:19 PM  
Blogger yeah shopping said...

While the Louis Vuitton handbags line began to coat, great Balenciaga handbags patent raincoat and military inspection at the local Balenciaga handbags well-known for many Christian Dior handbags years led the dress, perfume Jimmy Choo handbags boxes, the current custom Miu Miu handbags handbags. Robert menchetti, who in 1999, the Italian Prada handbags custom over the shares in Hermes handbags market in the awesome progress. Victoria Beckham Miu Miu handbags style defined by the elite, in the direction of the British Goyard handbags royal family – from David Beckham Kate Winslet Prince William Fendi handbags– red carpet or not, Marc Jacobs handbags style arrival stood up, in your interpersonal circle.

2:10 AM  
Blogger luck said...

The Nike Air Max shoe is a good Nike shoe,if you are interested,please contact us.Authentic quality and original package Nike Air Max Online.The design of Nike Air Griffey Max 1 colourway is very fashion.The Nike Air Max 1 is considered as one important part of Nike Air Max. This really is certainly the seek style provides you with additional effect factors on the court. In addition, this rubberized outsole with exclusive tread design so as to enhance the traction force.Be very careful to observe these particular shoes and select the footwear you enjoy very best and buy them at the first time.The Nike Shoes Us shoes are more popular year by year than preceding year.The most important thing that we provide is the preferential price and quality guarantee of Nike Air Max.Nike Air Max 2009 create a visual landmark as well as its color and greatly improve the air cushion cushioning and stability.Because of his lightweight design,unique streamline design, slightly retro look, make her to be popular by young people.

6:01 PM  
Anonymous Money Talks News said...

Nice post. Great blog. Thanks for sharing.
Money Talks|

4:17 AM  
Anonymous Nike mercurial soccer cleats said...

This Nike soccer cleats ultra vibrant New nike soccer shoes ...The Nike soccer cleats has a huge army of fans across the globe, and if you're one of them we know you love them to be bright, flashy and in-your-face colours. Checking out these nike mercurial vapor superfly III fg versions, part of Nike's Fall seasonal releases, we're sure you're going to love these Nike Football Cleats too, they combine Laser technology and Nike Mercurial Vapor Superfly with the Vapor series!especially once they start appearing en masse on pitch. You can click "VIEW MORE" for more detailed pictures. New levels of performance after nike mercurial vapor superfly III new levels of performance after.

5:30 PM  
Anonymous Anonymous said...

hi good article

5:32 AM  
Anonymous China tours said...

That is really cool. Thanks for finding it. Some really good ideas there, this is going to be a real time sink. I am a china tour lover,You can learn more: China travel packages | Asia tour packages | China city tour packages

8:35 PM  

Post a Comment

<< Home