Linux ssh autologin with putty

html">

ssh autologin with putty

This article shows how to do it when

connecting from a windows machine using putty to a linux box.

1. download PuTTYgen and start it.

2. at the bottom of the window, select SSH2 RSA

3. click generate and start moving your mouse over the blank part of
the window until the bar is filled and it shows some more options.

4. change the key comment to something meaningful like the name of your computer or you

5. save the private key (and if you want for later use, save the public
key too, but we don’t need this one for our auto login)

6. copy the public key from the textarea at the top of the window and
paste it into the ~/.ssh/authorized_keys file on your server you want
to logon in the home directory of the user you want to logon as. if
this file doesn’t exist yet, create it. (you may again want to
save the copy/pasted key to a text file on your computer in case you
have some more servers you want to auto-logon, so you can always open
it and copy/paste it from that file)

7. start putty and load your server settings

8. go to Connection–>Data and enter the username you want to
login as in the up most field “Auto-Login username”

9. go to Connection–>SSH–>Auth and choose the newly
reated private key file you saved before in the last field
“Private key file for authentication” by hitting the browse
button.

10. go back to Session and save all these settings.

now your’re done. from now on you will automatically be logged in when you open a session to that server

somem more tutorials for this and other os’s can be found here: http://wellsi.com/sme/ssh/ssh.html

More here for linux as well http://wiki.dreamhost.com/index.php/SSH#Passwordless_Login

Spyware trojan and virus removal tools

Hijackthis is one of the best. More here : http://www.spywareinfo.com/~merijn/programs.php

PHP and Related

http://www.dbforums.com/t1044828.html

I just installed Apache/PHP5/MySQL on my Windows PC with XP Home OS. I followed the Tut Installing PHP under Windows  by Matthew Phillips Referred to in the Post: Easy to understand Apache/PHP/MySQL install on XP box

This worked OK aside from a couple obvious differences. I had the most troube getting MySQL configured with PHP and had to do some searching to find the answer. Here is what I had to do to get it working.

In the Apache httpd.conf File at 'C:\Program Files\Apache Group\Apache2\conf\httpd.conf' You have to add these lines for PHP5

LoadModule php5_module php5apache2.dll
AddType application/x-httpd-php .php

In addition to installing MySQL etc. I had to do this to get MySQL to work:

1. Make sure that you have a valid php.ini in your windows directory.
OR (Per the tut the 'php.ini' can be installed in the 'C:\Program Files\Apache Group\Apache2' folder. This works fine.)
2. copy libmysql.dll to the system32 directory (php_mysql.dll would not load without doing this)
3. set the extension_dir in php.ini to the ext directory of your PHP installation directory (like e.g. extension_dir=C:\php5\ext)
4. enable the MySQL extension in php.ini by uncommenting the line extension=php_mysql.dll
5. Restart Apache Server

Check this link for latest php host
http://www.0php.com/free_PHP_hosting.php

Useful open source apps:

Online exam - TCExam (sourceforge project) perfect for online exam .(http://www.tecnick.com/public/code/cp_dpage.php?aiocp_dp=tcexam)
Fixes: Remember to add the user right (with groups , date format is yyyy-mm-dd)
Install the application through the application.
project management http://itprojectguide.org/

Drupal - an excellent content mgmt system.
Joomla - similar to Drupal
Imageflow - image gallery showcase.

Tomcat enabling security using Catalina.policy

Add the -security option in the startup script of catalina

For debugging security information have below setting in catalina
CATALINA_OPTS=" -Djava.security.debug=acess,failure"

The catalina.policy file should be present under $tomcat/conf/

Change the catalina.policy as required by checking the debug information

To check acess failures use the below:
grep -v "access allow" /usr/local/sso/logs/catalina.out |more

Note: -v is used to invert the search pattern.

or use
grep -v "access allow" /usr/local/sso/logs/catalina.out |egrep "domain|denied" |more

Pega PRPC

Pega is a collection of rules linked to a business process

Pega = Rules Engine + Business Process

It is smart as it is built for changes and has all the capabalities required in a SDLC(s/w development life cycle). Here is a few:

- An inbuilt Versioning system.Excellent feature to manage releases. Never seen such good feature in my career in other products.
- An inbuilt clipboard and tracing tool for debugging. Rule inspector for debugging HTML on the fly. What else do you want with zero developer configuration.
- Inbuilt security system. Imagine building security in J2ee world , it is really a pain.
- A interface to view/design/manage the work flow from any corner of the world. Just have a browser and you are done. You setup the server environment once. No need to setup any other environment  for individual developer. 
- Object oriented.
- Java Based and inbuilt internationalization support
- Can include new java libraries easily (Rule-utility)...
- Smart product for smart people.
-  Excellent external service integration
- It solves most of the repeatedly occuring problems in a J2ee webapp development and hence a sure winner. Most problems are captured as rules which can be changed easily.
- Rule testing capability like Junit in java.

What it lacks in V4.2(correct if i am wrong)
- Sucks lot of Memory. Maybe deu to the rules stored in memory.
- Customizing the user interface layout takes a hell lot of time and effort. Also depends on the skillset of the developer.
- Didn't find a worthy information of handling back button in a work flow. Going back from one flow to another is not possible.
- How do we support AJAX? Portlets , etc? Is it there in V5 ?
- Hard Core *Coder* will not like it as it is not as flexible and tunable. :)
-Bigger learning curve of rules. But with it's feature its worth.
- Not open sourced :-).  If it get's opensourced no other product can beat it.

[update]
Useful links 
Forum for pega
Question and answer

Developer notes 1 


More to come here
TODO:
-How to develop pega app from scratch quickly
-Best Practices
-Essential rules what a pega developer should know.

[updates]

Another developer blog on its experiences:

http://claforet.wordpress.com/2010/06/26/getting-started-with-pega-development/

Hibernate second level cache

Second level cache(2LC) of hibernate boosts the performance of websites.
One needs to be careful to handle the cache refresh.
By default hibernate 3 comes with EHcache for session level
cache(primary cache).
EhCache can also be used for secondary level cache.


Setup of 2LC using EHcache:

1. Setup the session factory with the below details:
hibernate.cache.provider_class as org.hibernate.cache.EhCacheProvider
hibernate.cache.use_query_cache as true

Optionally cache statistics can be enabled by using below

   hibernate.generate_statistics as true
   hibernate.cache.use_structured_entries as true


2. In the hbm files just under the class element put the below:
   cache region="com.xmp.web2.model.Article" usage="read-only"

   --in the above, the region is used to identify as cache key.

3. For query cache, set the Query as cacheable programatically.

   Query queryObj = session.createQuery(query);
   queryObj.setCacheable(true);

   -- This will cache all the query result, thus reducing DB hits.

4. To refresh a query programatically, do the below:
   --  sessionFactory.evict(Article.class, id);    //this will remove from the cache the article object instance with the primary key id. Note that the id is serializable and the type should be the same as defined in hbm.

5. To optionally print the statistics, enable statistic monitoring as told in step 1 and use the below:

static void printCacheStatistics(String regionName) {
 Statistics statistics = sessionFactory.getStatistics();
 SecondLevelCacheStatistics secondLevelCacheStatistics = statistics.getSecondLevelCacheStatistics(regionName);             
 System.out.println("2nd level CACHE Statistics :"+secondLevelCacheStatistics.toString());
}

To check cache statistics use the JSP as below:
<%@ page language="java" import="org.springframework.web.context.*,org.springframework.web.context.support.*,org.hibernate.*,org.hibernate.stat.*"%>

<%
String cacheRegion="com.xmp.web2.model.Article";

WebApplicationContext ctx =
 WebApplicationContextUtils.getRequiredWebApplicationContext(
  this.getServletContext());
SessionFactory sessionFactory = (SessionFactory) ctx.getBean("sessionFactory");
out.print(sessionFactory);
Statistics statistics = sessionFactory.getStatistics();
SecondLevelCacheStatistics secondLevelCacheStatistics = statistics.getSecondLevelCacheStatistics(cacheRegion);
out.print("<br/>");
out.println("Query cache hit count :"+statistics.getQueryCacheHitCount());
out.print("<br/>");
out.print("<br/>");
out.println("2nd level CACHE Statistics :" + secondLevelCacheStatistics.toString());

%>

Reference:
http://doc.javanb.com/hibernate-reference-3-2-4-ga-en/performance.html
http://www.hibernate.org/hib_docs/v3/reference/en/html/performance.html#performance-cache

An excellent write-up on 2ndLC http://tech.puredanger.com/2009/07/10/hibernate-query-cache/

All about UK Visa.

HSMP is a 2 step process as of now.I applied for HSMP visa through a consultant y-axis in Bangalore, India.
They provided good service for getting step 1done(HSMP acceptance). The second part(Entry clearance)
was hopeless service by y-axis. I feel like chewing that consultant who processed it.

They are very keen about proof's (original documents) which has to be genuine and no scope for any errors.

Eg: Say you have your salary credited through cheques, then in the bank statement
you wont have the mention that your XYZ company paid you the salary. So you need
to get a letter for the same from bank or company stating you got the salary from
XYZ company. As long as you prove yourself with the documents the chances of
rejection is very low. Also all your salary slips should be attested by the
corresponding authority.

H1 vs HSMP:

• The chances of getting visa depends on your documentation which serves as the proof of you skills. Not entirely on luck like in H1.
  

• It is not like H1 visa (phaltu lottery system and only done once a year ). HSMP's points calculator is best and you can calculate before hand if you are eligible for it or not. Also you can apply any time of the year as long as you have your documents right. UK guys are smart at applying rules i guess.
  

As I said before, it is a 2 step process-

1. Get HSMP acceptance from UK consulate by sending your documents, 400 pounds and details to UK. It took me 3 weeks for getting the HSMP accepted. Actually gathering all the documents for proof of salary, bank stmts, medium of instruction letter etc. took me 1 month. On a whole you should get this first part done in 2-3 months.

2. Once u get HSMP acceptance from UK office, apply for Entry clearance in chennai or
mumbai. I applied through local VFS in bangalore(VFS sent it to chennai).Paid Rs.17,000
at VFS office fee for EC. It is already 3 weeks since I applied. Yet to get a response. HSMP
visa Entry clearance application status can be checked from here

I have got the first part done(got HSMP acceptance letter), the second one is also done. 
Overall the entire process took me 6 months as of now.  I could have saved some 2 months had I got all the documents ready. By and large 
4-6 months.

Right now I am in UK. More to blog soon.

UK HSMP visa useful Links:

1. hsmphelp.blogspot.com/
2. Check the blog ec-hsmp.blogspot.com HSMP blog .On the right you can find various useful section's. This blog is one of the best. No need to go to visa consultant and shell out so much fortune.
3. http://www.workpermit.com/uk/hsmp_calculator.htm --> HSMP point calculator. This may change in first quarter of 2008. Watch out.
4. Job assistance in Uk 00 44 114 207 6020 -Aman http://www.vertex-solutions.co.uk/technical-recruitment/immigrationservices.asp Tel (UK): 08456 448 441
   

http://forums.gumtree.com/about2685-25.html

1. Direct Dial: (+44) 144 222 1320
   
2. Buy tickets for UK to/from india at
   
1. http://www.ticketstoindia.co.uk/result_new.aspx
3. For currency, time, phone number conversion check
   
1. http://www.timeanddate.com
   

FAQ
What is the cheap and best place to stay in london. What is the price of apartments?
   Eastham is cheap with lot of asians but not so safe. For a bachelor it will cost around 300 pounds for  a shared acco of 3 people.
   Around 450 for 2 people. Thats a rough estimate...Depends on the owner.
 
How much cash should one carry for travel and job search?
 Around 300 pounds for flight + travel.. You might spend 600 pounds a month overall staying here.
If u r traveling for job search you will need some more like 100 pounds more.
So that might cost you 2- 3 lak rs for 2-3 months to come here and stay ,search a job.... Its ur best try and luck how 
soon u get the job.

Suggest some possible ways to get a job by seating here in india?
Sitting in India and trying a job is not a good idea. Chances are i can say only 10%. If u want to get work form India , chances are u end up with an Indian company who has UK requirement.... Also many consultants here dont call indian numbers. You need to prepare yourself with finances so that u survive in UK for atleast 2-3 months without a job(that might cost you 2- 3 lak rs).

LinuxPerformance Tuning(apache,tomcat,linux) and related

Web profiling
-- HTTPAnalyzer --
-- YSlow --CSS,Javascript report , time/size measurement for individual component is good.
-- FireBug -- Net performance, for a quick analysis.
--Open STA
Tomcat profiling
-- JProfiler
-- Hot spots ,JDBC queries(J2ee components), object instance count are useful.

--Database connection pooling with optimal values.
Connection leakage in DBCP can be easily detected by settin logAbandoned=true in resource configuration (server.xml). This is a very nice feature and throws up the exact location of the code which is not closing the connection. These connection issues normally come up during load testing.Also the jndi resource configuration for DBCP should have ideal settings. The one used for our project is below:

[GlobalNamingResources]
[Resource
name="jdbc/cmpPubPool"
auth="Container"
type="javax.sql.DataSource"
driverClassName="oracle.jdbc.driver.OracleDriver"
url="jdbc:oracle:oci:@[TNSNAME]"
removeAbandoned="true"
logAbandoned="true"
maxActive="2"
maxIdle="2"
initialSize="2"
maxWait="-1"
username="[USER_NAME]"
password="[USER_PASSWORD]"
validationQuery=”select 1 from dual” /]
[/GlobalNamingResources]


JVM Tuning
Modify the heap size in JAVA_OPTS.


Apache tuning
prefork or worker module can be used.
prefork is non thread based.
Worker module is multi threaded and may yield a better performance.

Linux
--$top -- to check CPU status

top

Top has probably hundreds of keys to do whatever you want. A few are most useful for me.

The > key sorts by the next column (%MEM) instead of the default (%CPU). < sorts by the previous column.

Hit c
to toggle the display of command line arguments. Useful for me when I
have a lot of processes that otherwise just show up as “java”

Typing A
brings up the alternate display, showing processes sorted by different
fields with different columns. One section shows a nice memory-centric
view, for example.
Hitting z turns on colors. Z brings you to a color selection screen where you can pick colors you want. B turns on bold for some fields.
Hit W to save all your configuration changes to ~/.toprc where it will be loaded next time.
Type k allows you to kill a process without exiting top.

-- kill -3 <TOMCAT_PID> will log the threads running/inactive details useful for troubleshooting performance issues.
On windows use CTRL +Break.

Hardware
-Linux memory size can be checked using
cat /proc/meminfo --Gives RAM size
free -m -- Gives RAM size in MB (-k for kb)
df -H -- Human readable format of hard disk size


Useful links
http://jha.rajeev.googlepages.com/web2push

Powered by ScribeFire.

Spring + Hibernate Usefuls

The below custom BaseDAOHibernate class should reduce most of the common DAO related coding. The search and searchAdvanced will be used to wrap the select query related method calls.

package com.xmp.web2.dao;


public class BaseDAOHibernate extends HibernateDaoSupport implements DAO {

private static final Log LOGGER = LogFactory.getLog(BaseDAOHibernate.class);

protected DataSource dataSource;

public void setDataSource(DataSource dataSource) {
this.dataSource = dataSource;
}

public void saveObject(final Object object) {
getHibernateTemplate().saveOrUpdate(object);
}

public Object getObject(final Class clazz, final Serializable id) {
Object object = getHibernateTemplate().get(clazz, id);

return object;
}

public List getObjects(final Class clazz) {
return getHibernateTemplate().loadAll(clazz);
}

public void removeObject(final Class clazz, final Serializable id) {
getHibernateTemplate().delete(getObject(clazz, id));
}

public List findObject(final Class clazz, final String columnName, final String articleID) {
return getHibernateTemplate().find("from " + clazz.getName() + " tableAlias where tableAlias." + columnName + " in ( " + articleID + " )");
}

/**
* Accepts a HQL and ordered map of parameters.
*
* @param query
* @param parameters
* @return
*/
public List search(String query, LinkedHashMap parameters) throws xmpWebException {
boolean keepSessionOpen=false;
return search(query, parameters, keepSessionOpen);
}

/**
* Accepts a HQL and ordered map of parameters.
* The caller of this method should explicitly close the session.
* @param query
* @param parameters
* @parm keepSessionOpen -boolean to instruct if the session should be closed or not.
* @return
*/
protected List search(String query, LinkedHashMap parameters, boolean keepSessionOpen) throws xmpWebException {
List objList = null;
Session session = null;
try {
 if (LOGGER.isInfoEnabled()) {
  LOGGER.info(new StringBuilder().append("Searching ( query = ").append(query).append(" ,parameters =").append(parameters).append(")").toString());
 }
 session = getHibernateTemplate().getSessionFactory().openSession();
 Query queryObj = session.createQuery(query);
  queryObj.setCacheable(true);

 if (parameters != null) {
  for (Iterator iter = parameters.keySet().iterator(); iter.hasNext();) {
   String key = (String) iter.next();
   Object value = parameters.get(key);
   queryObj.setParameter(key, value);
  }
 }
 objList = queryObj.list();

} catch (Exception e) {
 String msg = new StringBuilder("Search failed ( query = ").append("Searching ( query = ").append(query).append(" ,parameters =").append(parameters).append(")").toString();
 LOGGER.error(msg, e);
 throw new xmpWebException(msg, e);
} finally {
 if (!keepSessionOpen) {
  if (session != null && session.isOpen())
   session.close();
 }
}
return objList;
}

/**
* Accepts a HQL and ordered map of parameters. Useful with pagination as it
* accepts pageNo and pagesize.
*
* @param query
* @param parameters
* @param pageNo - The starting page number
* @param pageSize - The max record size.
* @return
*/
protected List searchAdvanced(final String query, final LinkedHashMap parameters, final int pageNo, final int pageSize) throws xmpWebException {

boolean keepSessionOpen = false;
return searchAdvanced(query, parameters, pageNo, pageSize, keepSessionOpen);
}
/**
* Accepts a HQL and ordered map of parameters. Useful with pagination as it
* accepts pageNo and pagesize.
*
* @param query
* @param parameters
* @param pageNo - The starting page number
* @param pageSize - The max record size.
* @param keepSessionOpen - boolean to identify if session needs to be kept open or not.
* @return
*/
protected List searchAdvanced(final String query, final LinkedHashMap parameters, final int pageNo, final int pageSize, boolean keepSessionOpen) throws xmpWebException {
if (LOGGER.isInfoEnabled()) {
 LOGGER.info(new StringBuilder("Searching with ( query = ").append(query).append(" ,parameters =").append(parameters).append(" ,pageNo =").append(pageNo).append(" ,pageSize= ").append(
   pageSize).append(" )").toString());
}
Session session = null;
try {
 session = getHibernateTemplate().getSessionFactory().openSession();
 Query queryObject = session.createQuery(query);
 // queryObj.setCacheable(true);
 if (parameters != null) {
  for (Iterator iter = parameters.keySet().iterator(); iter.hasNext();) {
   String key = (String) iter.next();
   Object value = parameters.get(key);
   queryObject.setParameter(key, value);
  }
 }
 queryObject.setMaxResults((pageSize < msg =" new" query = ").append(query).append(" parameters =").append(parameters).append(" pageno =").append(pageNo).append(" pagesize= ").append(      pageSize).append(">                                                                                             

------------------------------------------------------------------------------------------------------------------------------------------------------------------------ The above should solve most of the basic coding effort in DAO layer which we do 90% of the time. Spring+Hibernate Junit testing: Spring framework provides a nifty base class (AbstractTransactionalDataSourceSpringContextTests) that provides automatic transaction rollback, exposing a JDBC template to interact with the DB and auto wiring of beans.

Lets take a simple DAO class that save a User object to the database:

public class UserDaoImpl extends HibernateDaoSupport implements UserDao { public void save(User user) { getHibernateTemplate().save(user); } }

Now in order to test this you would write a test class as below extending from AbstractTransactionalDataSourceSpringContextTests class.

public class UserDaoTest extends AbstractTransactionalDataSourceSpringContextTests { private UserDao userDao; private SessionFactory sessionFactory = null; protected String[] getConfigLocations() { return new String[]{"test-spring-config.xml"}; } public void setUserDao(UserDao userDao) { this.userDao = userDao; } public void setSessionFactory(SessionFactory sessionFactory) { this.sessionFactory = sessionFactory; } /** * Test the save method * */ public void testSave(){ String query = "select count(*) from user where first_name = 'Firstname'"; int count = jdbcTemplate.queryForInt(query); assertEquals("A user already exists in the DB", 0, count); User user = new User(); user.setFirstName("Firstname"); userDao.saveUser(user); // flush the session so we can get the record using JDBC template SessionFactoryUtils.getSession(sessionFactory, false).flush(); count = jdbcTemplate.queryForInt(query); assertEquals("User was not found in the DB", 1, count); } }

The test class has to implement the protected String[] getConfigLocations() method from the base class and return a String array of Spring config files which will be used to initialize the Spring context. UserDao and SessionFactory properties are defined with the setter methods and the base class will take care of injecting them automatically from the Spring context. Auto wiring will not work if there are multiple objects implementing the same interface. In such a case you can remove the setter method and retrieve the object using the exposed applicationContext as below.

/** * Overridden method from base class which gets called automatically */ protected void onSetUpBeforeTransaction() throws Exception { super.onSetUpBeforeTransaction(); userDao = (UserDao) applicationContext.getBean("userDao"); }

The base class also exposes a JDBC template object (jdbcTemplate) that can be used to query data or setup test data in the database. Note that you need to have a data source and a transaction manager defined in your Spring config in order to use the AbstractTransactionalDataSourceSpringContextTests base class. The data source defined in the config file will be bound to the exposed JDBC template. In the testSave method first we verify there is no record in the User table where first name equals to 'Firstname' using the jdbc template object. Then we call the save method on the UserDao passing it a User object. Now we simple verify there is a record in the table where first name equals to 'Firstname'. Before running the query we flush the current Hibernate session to make sure jdbcTemplate can see the newly added record. Thats it and when the testSave method exits the current transaction will be rolled back and the record inserted to the User table will not be saved. This is great as your test database will always be at a know state at the start and end of a test method. The spring config file will like below (test-spring-config.xml) :

<!DOCTYPE beans PUBLIC "-//SPRING//DTD BEAN//EN" "http://www.springframework.org/dtd/spring-beans.dtd">

<beans>
<bean name="userDao" class="com.dao.UserDaoImpl">
<property name="sessionFactory">
   <ref bean="sessionFactory"/>
</property>
</bean>

<bean id="sessionFactory" class="org.springframework.orm.hibernate3.LocalSessionFactoryBean">
<property name="dataSource">
   <ref bean="dataSource"/>
</property>
<property name="mappingResources">
   <list>
       <value>hibernates/User.hbm.xml</value>
   </list>
</property>
<property name="hibernateProperties">
   <props>
       <prop key="hibernate.query.factory_class">org.hibernate.hql.classic.ClassicQueryTranslatorFactory</prop>
       <prop key="hibernate.dialect">org.hibernate.dialect.OracleDialect</prop>
   </props>
</property>
</bean>


<bean id="dataSource" class="org.apache.commons.dbcp.BasicDataSource" destroy-method="close">
<property name="driverClassName" value="oracle.jdbc.driver.OracleDriver"/>
<property name="url" value="jdbc:oracle:thin:@localhost:1521:ORCL" />
<property name="username" value="test" />
<property name="password" value="test" />
</bean>


<bean id="txManager" class="org.springframework.orm.hibernate3.HibernateTransactionManager">
<property name="sessionFactory"><ref local="sessionFactory"/></property>
</bean>

</beans>

Useful stuff: HQL many to many query for retreival from UserTask ut where :journal in elements(ut.journals)

Single Sign on - OpenSSO

Single Sign on using OpenSSO.

OpenSSO was earlier called as access manager.
OpenFM is openSSO + federation (Cross domain support?)

It was a herculian effort to get it going with openfm/OpenSSO.

1. Access Manager(opensso/openfm) configuration:

Mainly it seems to be having bugs in the user interface of the webapp it provides.

• First thing I came across when deploying the openfm.war on linux was as below:

• 
  -First time when we go to http://localhost:8080/openfm and try to
  configure the openfm, it gives a error with no stack trace nothing . It
  misleads you with a path to log file which you can find in their(sso
  developers) dreams.GRRRR.
• Had to search around
  in Red hat linux Enterprise edition 5. Later figured that it creates a
  folder with name @BASEDIR@ under tomcat/bin/... Who can imagine a
  cryptic folder for logging sso errors that too under tomcat/bin/...
  Wasted almost 1.5 days on that ....
• In another version of linux, the above didn't work out. It was in tomcat logs catalina.out. Lucky!!
  
• The
  problem usually tends to be due to wrong JDK. The Sun JCE comes as
  default with Sun JDK but not with IBM JDK. The Sun JCE is used for
  encryption of password by open SSO.
  

• 
  Another important thing. First time you setup access manager you should
  be careful. Next time, if you try setting it up(by deploying new
  openfm.war) , it complains. Under windows u can simply delete the
  access manager folder created during installation (default is C:\Doc and settings\user name\)...

• Under linux it should be somewhere under /home/ by default. Search using locate access manager. The custom path would be the one which you setup openSSO using Configurator.jsp.
  

• If
  you mess up access manager by configuring authentication chain or data
  store, the work around is use the default module=DataStore as URL parameter eg: http://localhost:8080/openfm/UI/Login?module=DataStore

Then you can login as amAdmin

• By
  default the openfm ships with set of authentication plugin like JDBC,
  LDAP based , etc .Our requirement needed to compare the user entered
  auth password with MD5 encrypted password. Hence had to build a custom
  authentication plugin. Luckily sun provide service provider
  interface(SPI).Implementing this was a major effort as there is hardly
  any documentation or forum talking about it.Took a short cut by
  extending the sun provided com.sun.identity.authentication.modules.jdbc.JDBC.java and over riding transform() method. It works smooth
  
  

To add a custom authentication plugin, follow the below steps:

1. Move the custom
   
   authentication jar which you wrote (opensso_xmp_plug_v1.0.1.jar) into
   the ~/openfm/WEB-INF/lib folder.All the related property files should
   be on class path.
   

3. Copy the custom
   Authentication JDBC configuration file. amAuthxmpJDBC.xml into ~/openfm/WEB-INF/classes
   folder.Refer amAuthJDBC.xml in the same folder for creating a similar one for your custom auth module.
   

4. Register the module in
   serviceNames.properties abailable under openfm/WEB-INF/classes to have
   amAuthXMPJDBC.xml. (Add amAuthxmpJDBC.xml at the end)
   

8. Copy XMPJDBC.xml into ~/openfm/config/auth/default
9. Restart tomcat.
10. Login to Access Manager, Goto
    Configuration -- Authentication --Core
11. Enter com.xmp.security.plugin.XMPJDBC as New Value and click on Add to configure
    the new service.
12. Go to Access Control and
    select the realm (opensso). Click on Authentication > Module Instances
    and Add the previously configured XMPJDBC module to the authentication
    chain as shown below: Save the information.
13. Now the Login of opensso will use xmpJDBC module as default for
    authentication. If you want to login with the amAdmin user,
    module=DataStore need to be added to login URL (like
    http://localhost/openfm?module=DataStore)
14. Login with a valid userId and password (sample xello@xello.com/xello)
    The user is taken to the successful login page.
    

NOTE:

• Once a user is logged in successfully, the access manager by default
  looks for the user's profile through Id repo. This is the default
  behaviour. This can be over ridden by setting the property in
  realm(opensso) -- Authentication -- Advanced (look profile) to ignored.

• Using custom com.sun.identity.agents.filter.SSOTaskHandler class, we can
  insert a session attribute which is used by the SSO agent/application
  for auto login (discussed later , for now agent is like a client to
  open sso). The sample code is below:
  

public class SSOTaskHandler extends AmFilterTaskHandler implements ISSOTaskHandler

{...
public AmFilterResult process(AmFilterRequestContext amfilterrequestcontext) throws AgentException
{

.........
amfilterrequestcontext.getHttpServletRequest().getSession().setAttribute("SSO_VALIDATION_RESULT",ssovalidationresult);
.............
}
........
}

TODO: J2EE agent
The agent J2ee 007 would be hiding in the web application root web.xml(as AmAgentFilter) to provide secured access. ;)
AMAgent.properties is where the whole good behaviors of the badly behaving J2ee agent is configured. This is generated by amadmin tool and updated later. Check it below for only the important parameters to manually update
----------------------------------------------------------------------------------------------------------

#
# CDSSO PROCESSING PROPERTIES
com.sun.identity.agents.config.cdsso.enable = true
com.sun.identity.agents.config.cdsso.redirect.uri = /agentapp/sunwCDSSORedirectURI
com.sun.identity.agents.config.cdsso.cdcservlet.url[0] = http://172.20.41.39:6060/openfm/cdcservlet
com.sun.identity.agents.config.cdsso.clock.skew = 0
com.sun.identity.agents.config.cdsso.trusted.id.provider[0] = http://172.20.41.39:6060/openfm/cdcservlet

#
# LOGOUT PROCESSING PROPERTIES
com.sun.identity.agents.config.logout.application.handler[] =
com.sun.identity.agents.config.logout.uri[DefaultWebApp] =/web/xmpXMS/logout
com.sun.identity.agents.config.logout.request.param[] =
com.sun.identity.agents.config.logout.introspect.enabled = false
com.sun.identity.agents.config.logout.entry.uri[DefaultWebApp] =/web/xmpXMS/home
#
# NOT-ENFORCED URI PROCESSING PROPERTIES
# - notenforced.uri: A LIST of URIs for which protection is not enforced
# by the Agent.
# - notenforced.uri.invert: A flag that specifies if the list of URIs
# specified by the property notenforced.uri should be inverted. When
# set to true, it indicates that the URIs specified should be enforced
# and all other URIs should be not enforced by the Agent. Entries in
# this list can have wild card character '*'.
# Example of notenforced.uri:
# com.sun.identity.agents.config.notenforced.uri[0]=*.gif
# com.sun.identity.agents.config.notenforced.uri[1]=/public/*
# com.sun.identity.agents.config.notenforced.uri[2]=/images/*
#
com.sun.identity.agents.config.notenforced.uri[0] =
com.sun.identity.agents.config.notenforced.uri.invert = false
com.sun.identity.agents.config.notenforced.uri.cache.enable = true
com.sun.identity.agents.config.notenforced.uri.cache.size = 1000

#
# DEBUG SERVICE PROPERTIES
# - com.iplanet.services.debug.level: Specifies the debug level to be used.
# The value is one of: off, error, warning, message. ******** Funny thing, debug is missing but it actually is very useful for developers********
com.iplanet.services.debug.level=debug
--------------------------------------------------------------------------------------------------------------

TODO: Web Agent

Powered by ScribeFire.

The art of debugging

Software debugging is used to troubleshoot a problem in code.

So what is the best way of debugging?
1.  Run through the log statements
2.  Start  a debug session in your favourite IDE. The session can be remote(for a web app) or local.
3.  Narrow down to the problem by reducing the dependencies. Is it because of the framework or your own code, to know that  reduce the  code and test piece by piece.

Option 2, Debugger is the best arsenal for troubleshooting issues in code. Mixing 1,2 and 3 would be the ultimate way to fix the worst problem.
For details of remote debugging in eclipse please refer to my earlier posts.

In eclipse I find the below things very useful in debugging session:
  1. Breakpoints:
        1.Put a  breakpoint in eclipse. You can also edit the breakpoint properties by right clicking on the breakpoints           properties. Here you can put a condition and put S.o.p for quickly identifying the problem
       2. Exception breakpoint is a cool feature which will catch the exception which you specify. This will help you             find the control flow(especially with nasty Null pointer exceptions). You can specify this by clicking on the             "Add Java Exceptions" breakpoint of breakpoints view.

    2.If you're running in debug code, you can actually just edit
the method and re-invoke it. None of this resetting         variables on the
fly; just save the new method and do 'drop to stack' to get it to
re-run the code.
      You can't do this if you're not running your application in eclipse, but are rather joined to it as a remore                 debugger.

   3. Variables can be reset in debugging session through expressions or variables view.

   4. Short cuts:
              CTRL+SHIFT +I -- to check a variable after selection.
              F5, F6, F8

Useful links
Jacoozi - Remote Debugging with Eclipse

JNDI test JSP page

<%@ page language="java" pageEncoding="UTF-8" contentType="text/html;charset=utf-8" import="javax.naming.*" %>
<% InitialContext initialContext = new InitialContext();
   Object obj=initialContext.lookup("java:comp/env/jdbc/xmpPubPool");
   out.print(obj);
 %>

Useful Eclipse Plugins + shortcut keys

Here is a list of plugins and their usefulness:

• MyEclipse -- Is a heavy wieght champion among plugins.Has lot of good features that makes it good as well as bulky. It sucks lot of memory.

Swing Tools

• jigloo -- Very good, clean and free Swing code generator. Makes swing development like VB.

Code Analysis:

• pmd

Javascript:

• jsEclipse

• Teniga_Javascript_Editor

Miscellaneous

• Mylyn --- Connects to task repository and eases task managemnt.Also standalone support
• JadClipse --Uses Jad to decompile class
• jautodoc -- Very useful for quick API documentation.
• junitBuilder -- Generate Junit automatically for classes..Saves time
• moreunit - a must have for junit. http://moreunit.sourceforge.net/org.moreunit.updatesite/
• phpeclipse -- Good for PHP developers.
• VelocityWebEdit -- Cool velocity template validation and edit tool
• patternbox -- very useful for building regular expressions quickly.
• xmlbuddy -- neat small and simple xml editing tool.
• subclipse --SVN plugin
• NTail - tail for eclipse http://www.certiv.net/
• Eclipse HttpClient -- is a Rich HttpClient Plugin with stunning user interface and build on top of the famous Apache HttpClient
• Jar class finder - give a class , it will find the jar where it belongs to.

http://www.alphaworks.ibm.com/tech/jarclassfinder/download MDA tools/plugins ---These have the ability to generate j2ee code automatically based on model driven architecture

• andromda

AJAX Plugins

• aptana

DB Modelling

• Clay modelling tool DB_Modelling_jp.azzurri.clay

Short Cut keys : CTRL+E for switching editors.Ctrl + F6 to navigate between the open editors, CTRL+ F11 for executing last command. Refactoring ALT +SHIFT+R --rename variable ALT + SHIFT + M -- extract method Indentation CTRL + I -- correct indentation individually. CTRL + SHIFT + F -- whole page format. Creation: CTRL+ N. I found it much easier to press ALT + E (extend) to add extended class and ALT + A (add interface) to add interfaces in the new class wizard. My class will then come out with empty overridden methods and correct imports. Search CTRL+Shift+G, which searches the workspace for references to the selected method or variable. 5 stars. Agility F3 Go to a type declaration CTRL + SHIFT + UP(DOWN) -- move up or down to the next member CTRL+T on an interface name...This list the implementation of the interface. Very useful. 5 stars CTRL+. and CTRL+, Move to one problem (i.e.: error, warning) to the next (or previous). Ctrl-F6 is a great way to jump around between open editors. CTRL+F7 to switch views...Verrrry useful CTRL+F8 to switch perspectives. Ctrl-O in a class definition brings up Quick Outline. Start typing a member name and hit return once it’s unambiguous. Combined with Open Type this is a lightning fast way to go to any method in any class.ctrl-o ctrl-o to show inherited members too! Less typing

I think of Quick Fix as a tool for writing code, not something that just corrects accidental errors. Instead of trying to type perfect code and using Quick Fix only when you make a mistake, try intentionally leaving out code, then using Quick Fix to add it in. For example, call a function that isn’t defined, passing in all the arguments you want to to take. Use Ctrl-1, Enter to create an empty version of the function with all the right parameter types. I also like Quick Fix for creating casts. I assign an expression to a variable without a cast, then use Quick Fix to add it in.

Instead of declaring a variable and then assiging the value of an expression to it, try just writing the expression, then use Quick Assist – Assign to Field (Ctrl-2 L) to generate the declaration. The variable name will be highlighted and the drop down gives you several reasonable alternatives to use for the variable name. Tab again to get to the type to choose an alternative. For example if you had new ArrayList<String&gt;() and used Assign to Field you might choose List<String&gt; from the list of type alternatives.

More here : http://eclipse.dzone.com/news/effective-eclipse-shortcut-key

More here : http://rayfd.wordpress.com/2007/05/20/10-eclipse-navigation-shortcuts-every-java-programmer-should-know/

Powered by ScribeFire.

linux tips

Tomcat Remote debugging in linux
Put the below in catalina.sh

JPDA_TRANSPORT=dt_socket
JPDA_ADDRESS=5005
$./catalina.sh jpda start

Startup script with logging: Create a file with the following and change the mode to executable under $catalina_home/bin ./startup.sh;tail -f ../logs/catalina.out For shutdown create as below: ./shutdown.sh;tail -f ../logs/catalina.out Restart script for linux: ./shutdown.sh echo "shutdown.sh executed" echo "Sleeping for 5 seconds after shutdown" sleep 5 ./startup.sh echo "starting up" echo "Sleeping for 1 second" tail -f ../logs/catalina.out Jar usage $cd portal-impl $jar xvf portal-impl.jar :extracts the jar file into portal-impl dir. $jar cvf portal-impl-patched.jar portal-impl/ :make jar file from portal-impl dir contents the jar will be having portal-impl as the root dir. To change ownership: $chown tomcat:tomcat FILE_NAME To change group: $chgrp tomcat FILE_NAME To Switch user: $su USER_NAME

Clear all unwanted .SVN files

find . -name ".svn"-exec rm -rf {} \;

JProfiler - A J2ee profiling tool

This is one of the best profiling tools i have seen.
They give a 10 day free evaluation with all feature's enabled.

Setting up the Jprofiler was a little tedious until I came to know how it works.
I was expecting that the Jprofiler would put some custom code in tomcat(like profiler4j) but actually it runs the tomcat in it's own session.

On windows, setup the application with downloaded exe.
Go to New -- Start center -- New Server integraion and you are done.
The app server gets started and log console is available through Jprofiler itself.

Another nice feature of jProfiler is remote connectivity. We can connect to server running in linux from windows.
To do that, install jProfiler on linux as below
 rpm -i http://download.ej-technologies.com/jprofiler/jprofiler_linux_5_0_1.rpm
Get the catalina.sh(for tomcat) and give to the start center wizard. Copy back this(jprofiler_startup.sh) to tomcat on linux. Now start the server using jprofiler_startup.sh.

Connect from windows GUI and you are ready for profiling..


The real thing :
Profiling can be done for memory or CPU load. The hot spots are the best ones to quickly find out the problem areas.
Also J2ee components can be easily profiled for JDBC calls, JMS calls,etc.





Powered by ScribeFire.

Apache 2.x setup Quick guide for Linux

I am herewith trying to log all the issues faced during apache web server setup.
Download apache from http://httpd.apache.org/download.cgi

There you can find either a source or binary.

Normally it is good to compile the source to a OS platform. But it is little extra effort. Setting up using a apache binary is faster but may not be reliable.

Here are basic and advanced steps for apache setup:

To setup , follow these very basic steps to setup apache in it's default location
Extract the apache bundle

1. tar xvf apache.x.tar
2. cd apache.x
3. ./configure
4. make
5. make install
6. cd ./apache/bin
7. ./httpd -k start[stop] # run's on port 80 which is default

Open browser..Go to http://localhost/ #....This should open a page ...It Works!!

To make an advanced setup like configuring additional modules, setup destination,etc , do the following:

1. tar xvf apache.x.tar
2. cd apache.x
3. ./configure --prefix=/path/to/apache --enable-[auth]=shared
4. make
5. make install
6. cd ./apache/bin
7. ./httpd -k start[stop]


Go to ./apache/conf/httpd.conf to change the port or any other setting. Will blog later on httpd.conf .

To have apache use a custom httpd.conf on startup do this :
./httpd -k start -f /custom/conf/httpd-custom.conf

To chek if apache supports DSO, run
./httpd -l # this lists all the modules setup in apache

I have listed a set of modules which were enabled for apache 2.0.59 to run a website on production:

--enable-authn_file=shared --enable-authn_anon=shared --enable-authz_host=shared --enable-log_config=shared --enable-logio=shared --enable-expires=shared --enable-headers=shared --enable-setenvif=shared --enable-mime=shared --enable-status=shared --enable-vhost_alias=shared --enable-dir=shared --enable-alias=shared --enable-rewrite=shared --enable-access=shared --enable-auth=shared --enable-userdir=shared --enable-autoindex=shared --enable-negotiation=shared

There are thousands of directives to be configured in httpd.conf .Refer http://httpd.apache.org/docs/2.2/mod/directives.html for apache 2.2

To change the server port by changing in ./apache/conf/httpd.conf the Listen 80 directive

Virtual host directive : A single apache server can have multiple virtual hosts and can server different sites.

To set this, open ./apache/conf/httpd.conf and enter the directive as below:


<VirtualHost 172.20.41.39:80>
 ServerName xyz.com
 ServerAlias www.v2.xyz.com v2.xyz.com www.eetonline.com www.xyz.com eetonline.com

 DocumentRoot /web/docs/electronics/v3.xyz.com
 DirectoryIndex index.html index.htm
 ErrorDocument 403 /nopagefound.jhtml
 Redirect /uk/motorola http://www.xyznet.com/
 
 <Location "/globalSpec"> # to specifiy the mounted directory to be used
  ExpiresActive on
  ExpiresDefault "access"
  Header append Cache-Control "no-cache"
  Header append Expires "Thu, 4 Jan 1990 10:00:01 GMT"
  Header append Last-Modified "Tue, Jan 27 2099 23:59:59 GMT"
  Header append Pragma "no-cache"
  Options FollowSymLinks MultiViews
  satisfy any
  Order deny,allow
  Deny from all
  AuthType Basic
  AuthName "xyz login"
  AuthUserFile /web/admin/apache/etc/auth/xyz.com-globalSpec
  require valid-user
 </Location>
<VirtualHost>

Chess

Blind folded Chess I browsed a few sites for how to start off with blind folded chess. Infact the chess player need not be blind folded. He just needs not to see the board. The mind is the board, the scratch pad for tactics and thinking. Start with basic's ..Try moving pawns in your mind, then knights, then rook, bishop and then queen. Crafty is a nice little program to play blind folded chess. [www . craftychess . com] This follows algebraic notation and has only a command line interface. It clearly shows how the program is taking decisions. Really playing blind folded expands your mind tremendously. More to come as I explore this Blind folded!! Good chess links: http://susanpolgar.blogspot.com/ -- GM susan polgar's blog. http://www.rajaravisekhar.com/

Powered by ScribeFire.

Spring portlet mvc and spring servlet mvc validation

Spring mvc is easy to get along with, unless we get the basic flow right. We end up wasting lot of time figuring out the flow of control/binding of errors for validation/etc. Spring portlet mvc validation

1. extend AbstractCommandController or SimpleFormController
2. In case of AbstractCommandController implement the method handleRenderView(req,res,command,errors)
3. Important thing to note is that you should return the ModelAndView as new ModelAndView(jspPage, errors..getModel());

• Note the method handleRenderView() is called even if validation fails. Hence we have to return back the command object having errors using errors.getModel().

Spring servlet mvc validation

• Implemented a simple form controller.

class ManageProfileController extend SimpleFormController { public ModelAndView onSubmit(HttpServletRequest request, HttpServletResponse response, Object command, BindException errors) throws Exception { Map modelMap = new HashMap(); return new ModelAndView(forwardJSP, modelMap); } }

• The configuration in *-servlet.xml is as below (assume dispatcher servlet is configured already)

<bean id="manageProfileController" class="com.TEST.web2.portlet.controller.common.ManageProfileController">        
        <property name="registrationService" ref="registrationService"/>
        <property name="formView"><value>common/manageprofile</value></property>
        <property name="commandClass"><value>com.TEST.web2.model.DpsUser</value></property>
<property name="validator" ><ref bean="userValidator"/></property>
      <property name="successView"><value>common/manageprofile</value></property>
    </bean>    

 On validation error, in servlet mvc, the onSubmit() is not called and the command object is available with errors.
To extract the errors in JSP use:


<spring:bind path="command.confirmPassword">
   <c:out value="${status.expression}"/>  <input name=confirmPassword type="password" style="width:200px; " onKeyUp="document.getElementById('cpw').value=this.value" value="<c:out value="${status.value}"/>">
    <font > <c:out value="${status.errorMessage}"/> </font>

</spring:bind>

Castor --The XML Marshaller

Forget writing XML parser...Castor will take care of parsing. It generates the java
classes to work with XML.

To use castor, -- put the below lib's in classpath -- ./lib/castor-0.9.9.jar ./lib/castor-0.9.9-srcgen-ant-task.jar ./lib/castor-0.9.9-xml.jar xercesImpl.jar; commons-logging.jar -- Run java org.exolab.castor.builder.SourceGenerator -i test.xsd -dest dtnFolder --optionally specify the package name if required. -- To convert from DTD to XSD use java org.exolab.castor.xml.dtd.Converter dtdFileName newXSDFileName To use the generated code:

• To run the unmarshal the castor lib should be in class path and follow the sample code herewith.

// Create a Reader to the file to unmarshal from
reader = new FileReader("test.xml");

// Marshal the person object
Person person = (Person)Unmarshaller.unmarshal(Person.class, reader);

• To marshal an instance of the person class you simply call the Marshaller as follows:

// Create a new Person
Person person = new Person("Ryan 'Mad Dog' Madden");
person.setDateOfBirth(new Date(1955, 8, 15));

// Create a File to marshal to
writer = new FileWriter("test.xml");

// Marshal the person object
Marshaller.marshal(person, writer);


Follow the document of castor for details.

LINUX usefuls

html'>linux basic commands:
ls
ls -a -- lists all files (hidden as well .)
ls -l -- list with permission and details

ln -s A B -- create soft link btw two file/folders

ps -- see current process
ps -e -- see background process as well
ps -H -- list process hierarchy
ps -f -- ?
pstree
top - see all proc's at one shot
pmap [PID] : list all the resource held by this proc.
cat /proc/[PID]/maps :

kill -3 [PID] -to get the status of threads
$ killall httpd -kill all the procs with name httpd

grep -- useful for search. Very powerful if we combine with other commands
eg: ps -ef | grep liferay == will return all the liferay process

fg -- bring the process to foreground
bg -- send the process to background
CTRL Z -- send the process to background..Can bring it to foreground using fg.
CTRL C -- close a program.

tail myfile.txt -n 100  -- list the last 100 lines in
            the file

mail -s "picture of me surfing" sylvia@home.com < surfing.jpeg  --- To mail a file
tail -f catalina.out --display the contents in real time
head -15 myfile.txt - Would display the first
            fifteen lines of myfile.txt.

diff -r -N folder1/ folder2/        ---find difference b/n folders.. -N do display diff content.


cat test.txt --display content of file test.txt

cat t.txt t2.txt > t3.txt -- merge t.txt+t2.txt= t3.txt

difference b/n folder
du -hs liferay1/webapps/* liferay2/webapps/*


touch file.txt -- quickly create a empty file

VI editor commands
i -- insert mode
r -- replace mode
/ -- search
:%s/fred/joe/igc : general substitute command(replace)
w -- write
wq --write and quit
q-- quit
:#20 - moving to a line 20
Ctrl u --page up
Ctrl d -- page down
:set number -- to set the number
~ Toggle case of the character under the cursor, or all visually-selected characters.
q: You can bring up the command line history while in Normal mode.
:42G -- ways to go to a particular line (line 42 for example)
Multiple Files Management

vim test xyz

:bn -- next file

:bp -- next file

:wn -- write file and move to next (SUPER)

Screen
Ref:  http://www.kuro5hin.org/story/2004/3/9/16838/14935

Screen is best described as a terminal multiplexer.
Using it, you can run any number of console-based
applications--interactive command shells,logging, curses-based
applications,
text editors, etc.--within a single terminal.Also can reattach again to
the screen even after logout.Excellent isn't it. Should have had a
separate blog :0). Any way the quick reference below:



$screen  --Start screen just by typing screen at your favorite command shell prompt

Ctrl a c --create another screen

ctrl a ctrl A --switch screen

ctrl a n -- switch next screen

ctrl a p -- switch prev screen

ctrl a A -- Give a name to the current screen.

ctrl a " -- to get a full-screen list of windows

ctrl a K --You can also kill misbehaving programs

$screen -r --will reattach the screen to the current session which.

Networking commands:

ping

netstat -- active connections
netstat -r --shows routing table


ifconfig (like ipconfig in windows)
ifconfig eht0 down -- shutdown lan card (to renew ip u can do this)
ifconfig eht0 up --startup lan card

iptraf
nmap -- port sniff
dig

NATing
/etc/hosts file
It is used to map simple human readable names with ip address.
Eg:
127.0.0.1 localhost.localdomain localhost
127.0.0.1 access.idp1.com

Installation
rpm -i foo-v123.rpm        ---install a package
rpm -i http://oss.oracle.com/kernel-2.4.20-18.10.1.i686.rpm
rpm -e foo
rpm -qi foo    -- To query a RPM package and display info
more details refer http://www.idevelopment.info/data/Unix/Linux/LINUX_RPMCommands.shtml

Autoexec.bat in linux
vi /root/.bashrc   # the user is root here.
---Do whatever needs to be done on login in the .bashrc
To load the properties without relogging in use : source /root/.bashrc

Secured remote copy:
scp <target1> <target2>
eg: scp test.zip sandeepm@xHost:/export/home/sandeep  -- copies the test.zip to the target2 from target 1.
scp sandeepm@xHost:/export/home/sandeep/test22.zip . -- copies the test22.zip from target2 to target1 .


Use grep recursively
You can  search recursively i.e. read all files under each directory for a string “192.168.1.5″

cd /etc

$ grep -R "192.168.1.5" *

Use grep to search words only
When you search for boo, grep will match fooboo, boo123, etc. You
can force grep to select only those lines containing matches that form
whole words i.e. match only boo word:

$ grep -w "boo" /path/to/file
Grep invert match
You can use -v option to print inverts the match; that is, it
matches only those lines that do not contain the given word. For
example print all line that do not contain the word bar:

$ grep -v bar /path/to/file
Count line when words has been matched
grep can report the number of times that the pattern has been matched for each file using -c (count) option:

$ grep -c 'word' /path/to/file

To get the DB conn list
$ netstat|grep -c app610

Shell script
The below will run a command for configurable no of times.
chmod +x test
usage : ./test [NO_TIMES] [COMMAND]

for ((  i = 0 ;  i < $1;  i++  ))
do
      echo "Executing $2";
       $2;
      sleep 1;
done

More scripts here http://www.usd.edu/~sweidner/lsst/
 


One of the best methods to capture a Unix terminal session is to use the `script` command.

In this example we start a script session, run a couple of commands,
and then use the `exit` command to stop capturing the terminal session:

$ script
Script started, output file is typescript
$ pwd
/home/will
$ ps
PID  TT  STAT      TIME COMMAND
11909  p0  Ss     0:00.05 -bash (bash)
25622  p0  S+     0:00.01 script
25623  p1  Ss     0:00.01 /usr/local/bin/bash -i
25624  p1  R+     0:00.00 ps
$ exit

Ref:
http://vim.wikia.com/wiki/Best_Vim_Tips