RCAPD

resource cap enforcement daemon

For older Solaris. Modern way project.max-locked-memory

# rcapadm -E 	-> enable the daemon
# projmod -K 'rcap.max-rss=134217728' system -> limit RSS to 128MB
# svcadm restart rcap
# newtask -p system <command> 
# rcapstat