Sean Cull

Please don’t be shy at Lotusphere

Sean Cull — Sat, 14 Jan 2012 15:21:20 +0100

Can I ask all of you who are lucky enough to be at Lotusphere one favour ?

Please don't be shy.

We are all customers of IBM, we pay them hard earned money so that we can use their products and services.

They are also genuinely interested in our views about how to make their products and their approach to selling their products better - so tell them what you think would work better.

At UKLUG this year a group of about ten of us were standing talking about the future of XPages and our frustrations with the licensing schemes that were available.

Ted Stanton from IBM had given the Key Note at the event and happened to be walking by.

We sort of "door stopped" him and asked if he would listed to our views. He very graciously did and later took the time to write those up and pass them on to others such as Ed Brill and Pete Jenzen.

I did initially feel a bit bad about pouncing on him but he recognised our enthusiasm for his products and we had a really good ad-hoc session. Pete Jenzen then followed up with various members of the group over the next few weeks and some of what was discussed probably helped influenced the shape of the XWork server.

I have also found that the developers and support guys to be fantastically helpful. Martin Donnelly , Tony McGuckin, Susan Bullock , Mary Beth Raven ( now ex IBM ), Maureen Leyland, and various others have all taken the time to understand my ideas and make helpful suggestions on previous occasions.

And there's also the irrepressible Joyce Davis who is the linchpin of IBMs community outreach work,

The Lotusphere Labs are a great way to meet the people who actually code the stuff we love. Go play with their new stuff and tell them what you think.

Have a think about what the top 5 things you would ask for would be AND why.

For me as a developer it would be :

1) SSJS debugger because it would cut our costs by 20% +

2) Automatic SSJS syntax checking because it would really reduce the risk of breaking apps in production.

3) Full feature parity in XPINC generally but specifically for opening documents using parameters so that we can have full fidelity XPinC apps.

4) Removal of the 64K limit in SSJS @dbcolumn lookups so I can have filters on XPage views where I won't get empty results.

5) Better ( some even ) control over which replica a link will open because too many customers seem to end up inadvertently using servers in Aberdeen, Brazil, China.etc..

Oh, and one last thing, make sure you tell them the 5 best things that they have already given you !

For me it would be

1) XPages

2) Support of OpenNTF

3) A rich Application Server that I can deploy very easily on a range of Operating Systems

4) The XWork server and the opportunity to loose the negative conjurations associated with Lotus ( which annoy me but we need to move on )

5) The mobile, REST and RDBMS functionality appearing in XPages.

5.1) XPINC - It really serves our customers well - the always connected world isn't here yet.

5.2) OneUI - seriously, it makes my life as a developer much easier.

Thanks and have a great time. I'm not jealous at all ;-)

Sean

Configurable low overhead scheme for date dependent colour coding in views

Sean Cull — Fri, 23 Dec 2011 21:06:10 +0100

It is useful to have colour coding of target dates in views but in traditional Notes applications ( as opposed to XPages ) this carries a big overhead if you do the date calculation in the actual column using @today etc.

Also see Steve McDonagh's post on colour blindness. You could also use this approach for icons.

This scheme uses a scheduled agent to replace the column formula each night with a hard coded date. It runs on 120 views in less than 1 second.

The scheme also uses a configuration document for the formula so that super users can update the threshold values.

There are 3 parts to consider :

1) the column formula. The image below shows it in the configuration document.

The bits in yellow are the constructors that are used to insert the relevant dates for the banding.
In this case
> 5 days away is neutral
0 - 5 days is yellow
overdue = red

2) The column in the view.

This column is hidden and has the property "Use value as colour". This title of this column must start AGENTLINKED so that the scheduled agent can pick it up and modify it ( see below )
There must also be another column to turn the colour off again. The value of the formula after the agent has run is shown below - you can leave it blank and then run the agent to populate it.

3) The Scheduled Agent

The scheduled agent loops through every view and every column within each of those views.
Where it finds a column with he AGENTLINKED string in the title it tries to update this.

When updating it :

1) extracts the relevant configurable formula string from the configuration document shown above. You can have multiple configuration documents in case you need different target thresholds for different views etc..

2) it replaces the [#n#] with a date which is n days from now

3) it inserts the modified formula into the column as shown above.

Sub Initialize

' Sean Cull, FoCul Ltd.
' Released under Apache 2.0
' The purpose of this agent is to modify the column formula
' for columns so that dates can be highlighted as they become overdue.
' the column title will need to start with the phrase ".AGENTLINKED"
' e.g .AGENTLINKED : Colour_on_001
' this is then used for the keyword document that contains the formula.
' in the keyword document date increments are notated byu [#x#] where x
' is the number of days from today.
' e.g @If ( target_date_dt > [#3#]; bgd:Dark_Blue ; ........
' full example : red := 255:0:0; blue := 0:0:255; green := 0:255:0; gold := 255:128:0; black :=0:0:0; white := 255:255:255 ; yellow:= 255:255:0; bgd := 224:241:255 ; Dark_Blue := 0:0:128; @If ( target_date_dt > [#3#]; bgd:Dark_Blue ; target_date_dt >= [#0#];yellow:black; target_date_dt < [#0#];red:white; -1:-1:-1)

Dim session As New NotesSession
Dim rightNow As New NotesDateTime(Now)
Dim db As NotesDatabase
Dim configview As NotesView

Set db = session.CurrentDatabase
Set configview = db.GetView("vlukeywords")
ForAll v In db.Views
ForAll vc In v.columns
If InStr(vc.Title,"AGENTLINKED")>0 Then
Call process_column(vc,configview)
End If
End ForAll
End ForAll

End Sub
Sub process_column(vc As NotesViewColumn, configview As NotesView)

Dim configdoc As NotesDocument
Dim strvar As String
Dim strvar2 As String
Dim pos As Integer
Dim pos2 As Integer
Dim incrementstr As String
Dim datestr As String
Dim dt As New NotesDateTime("Today")
Dim z As Integer

Set configdoc = configview.GetDocumentByKey("." + vc.Title )

If configdoc Is Nothing Then
MsgBox " could not find configuration key ." + vc.Title
Exit Sub
End If

strvar = configdoc.KeywordList_tx(0)

pos = InStr(strvar,"[#")
Do While pos > 0
Call dt.SetNow
strvar2 = Right(strvar,Len(strvar)-(pos+1))
pos2 = InStr(strvar2,"#]")
If pos2 = 0 Then
MsgBox "Error, did not find closing #] in column formula"
Exit Sub
End If
incrementstr = Left(strvar2,pos2-1)
Call dt.AdjustDay( CInt(incrementstr))
datestr = "[" + CStr(dt.DateOnly) + "]"
strvar = Replace(strvar,"[#" + incrementstr + "#]", datestr)
pos = InStr(strvar,"[#")

Loop

vc.Formula = strvar

End Sub

So how do you open an xpage in a different database in XPINC ?

Sean Cull — Tue, 20 Dec 2011 00:27:03 +0100

I have spent a large chunk of the weekend and tonight trying to make a suite of XPages applications work in both XPINC and the browser.

I'm still confused

How it works when everything is in the same database

If you want to open a document from a repeat when it is from the same database the recommended method is to use Open Page simple action using parameters and it works really well for both browser and XPiNC and is also helpful in that it is a put request rather than a GET request ( Mastering XPages page 658 ) - apologies to Tony McGuckin who I promised I would blog this 9 months ago.

The problem with data sources from other Notes databases

OK, so XPages is all about consolidating the presentation of multiple data sources in one place.

How then do you open a document from another database via a repeat ?

The crux here is that the dialogue above only presents "XPage" choices for the current database and there is no way of computing the other database - so you cannot use the simple action method.

Well for the browser you construct a URL, that is pretty straight forward. But what do you do for XPiNC ?

There are 3 methods which I believe should work although I have found that 2 are very flaky for me.

1) You can modify the underlying form associated with the XPage so that if the document is called then it will automatically be presented as the relevant XPage

To do this you would use a URL like this :

notes://server as common name/0/universalid

The downside to this is that where I work our "Best Practice" is to be able to open the back end forms as native Notes forms for administration and troubleshooting - it is a very powerful tool.

I also have some suspicions as to whether the specified server is honored in this scenario.

So all in all not a good option.

2) You could call the XPage using the following construct

notes://server as common name/dp replica id/xp_f_document.xsp?openXPage&action=readDocument&documentId=8E800DB89E9E144A80257968004CDEE4

This should work although case sensitivity may be at play on our linux server - its hard to tell sometimes as daft as that sounds.

This method only works on 2/3 of my documents. I have eliminated issues with the logic on the XPage being the cause by using a very simple XPage with no improvement

So all in all not a viable option.

3) You could use a non rendering XPage with a "before render" script to redirect to the correct document.

This would be in the target database but might be more than 2/3 reliable. This would be a pure frig but I am tempted.

Again, not a great choice.

Some Observations

I have been on a real high with XPages of late and we have been doing some great stuff which I hope to share soon. But this project is dual XPINC and Browser.

Just at the moment I am beat - this feels like the dark days of XPages 8.5.0 and 8.5.1 - spending hours and days getting nowhere and feeling like you are the first to try something and find it lacking.

If XPINC is to be a first class client and if IBM is to deliver the vision of code once deliver on many platforms ( which is so so close based on my recent experience ) then XPINC needs to get more exposure inside IBM.

It simply wasn't usable in 8.5.2 but is much better in 8.5.3. Darren Duke once said that he would know XPages was here to stay when the mail client was in XPages - in my opinion that would make a big difference in flushing out the issues.

Come on IBM, drink your own XPages champagne.

I am very honoured to be an IBM Champion

Sean Cull — Wed, 14 Dec 2011 21:39:36 +0100

Warning, long and rambling post ahead.

Its been almost a week now since IBM made me an IBM Champion for IBM Collaborative Solutions and it is just beginning to sink in. It is a fantastic honour and I am very humbled by it. I am a huge fan of Notes and XPages and am very impressed with what IBM has given us in terms of both the platform and their very significant contributions to OpenNTF.

I started with Notes in 1995 and have been blogging since 2008. I find blogging and commenting on Notes a difficult balance. When you are so passionate about something it can be very frustrating when you feel that it could be even better. It is my nature, and my professional background, that I always push for things to be better than they are, sometimes that is seen as a negative but at other times people appreciate the feedback. Sometimes I still get it wrong and am too flippant with my comments.

To be honest receiving the award did make me stop and think if I should be more "positive". It coincided with a great experience of Notes with a customer which reminded me how powerful Notes is and also the experience of installing and using Notes on a brand new MAC. The Notes on MAC experience was not so good.

Having thought about it a bit more I have decided that I should just be "me" but I should make more of an effort to take the time to tell my story about how I see Notes ( and IBMs wider collaboration solutions ) helping businesses manage costs, processes and knowledge but at the same time not to shirk away from saying what needs to be better too.

It has been a frustration of mine for some time that not enough is said about the huge value that the IBM collaboration solutions add to businesses around the world every day. Most of us who work with Notes are proud to be Geeks and we want to see the demos at the OGS ( remotely in my case unfortunately ) but the reality is that if Business Leaders do not understand what the IBM platform ( that they often already have ) can deliver then there will be no install base for us to deliver to. I guess it is for that reason that LotuSphere has become LotuSphere + Connect.

It will also be interesting to see how IBM positions XPages. I am an applications person at the end of the day. I can see that Connections and other Social collaborations tools will become increasingly important but a lot of business is about structured collaborative processes. Many of these processes are "sub enterprise" and at the departmental or site level - this is where, in my view, Notes and XPages are at their strongest. There is still no other application platform that can plug these sub enterprise collaborative requirements as well as Notes. I think that IBM lost sight of this and Microsoft won the email battle even though the war was about much more than email.

Which brings us to XPages. XPages has been revolutionary in terms of improving the solutions that we have been able to deliver. At work we are flat out building our XPage skills and delivering some fantastic applications. We only have a relatively small set of loyal customers and as a business owner I feared that we had reached saturation by having done all of the obvious things with Notes. XPages has totally changed that with customers who are on 853 and those who see value in bringing their own customers into their collaborative processes via the browser. About 30% of our work over the last year has also been with net new customers who don't have "Notes".

Being totally honest I have never quite understood why IBM gave us XPages. Don't get me wrong I will be eternally grateful that they did but it did seem to come out of the blue. I'm guessing here but I suspect that its success took some at IBM by surprise. Long before XPages an IBMer said to me - "Nothing in IBM is allowed to be a failure - it gets recycled into a success" - XPages is certainly a success. The next question is how does IBM position it ?

I understand that "Social" is important and that it is a wave worth riding but I can't be the only one who is uncomfortable with the "Social" label - actually I know that I am not because my mainly industrial customers are uncomfortable with that label too. They are all for collaboration but their main need is for structured workflow and knowledge management processes that deliver and demonstrate control of processes and knowledge. Having said that Activity Streams have huge potential and IBM is delivering tools to integrate XPages with Connections for just that reason.

How would I like to see IBM position XPages ?

I have heard IBM describe XPages as the "framework for building collaborative social business applications" - that is much to narrow.

XPages will certainly be a great platform to build the structured business process that will follow and compliment the more free form Social processes but it is not just about social.

I have no idea if it is technically feasible but I hope to see XPages in WebSphere and on every other IBM platform. I would love to see IBM throw their weight behind it as "the" IBM collaborative development platform. By all means leverage the "Social" buzz but also recognise that there is a demand for collaborative applications from people who do not see their need as "social" or who, and perhaps I am one of them, misunderstand what IBM means by social.

Actually I do think I understand what IBM means by Social - its essentially people working together - which is what collaboration is - but I still find the label uncomfortable and my customers even more so.

Anyway, I have rambled on even more than ever, and probably caused a few IBM people to wonder why I was made a champion. I am very pleased that they did make me a champion and I am looking forward to telling all who will listen ( I'm impressed if anyone still listening now ! ) as many good business success stories around IBM collaboration as I can find.

What advice would you give a MAC newbie ?

Sean Cull — Fri, 25 Nov 2011 17:51:43 +0100

Having mulled over a new laptop for a very long time I am now the proud owner of a MBP.

When I got new Windows Laptops I always imaged them so that I could roll back to a clean machine easily. I also had a list of useful software such as clipcache, acronis, winscp, putty etc..

What would you recommend I do with the MBP ?

Also any suggestions for a smart backpack and / or sleeve (15") ?

Will the MBP really help me loose weight as demonstrated above ?

Thanks, Sean
p.s. I am mostly a developer with Linux and Windows servers

New IBM supported XPages Extension Framework Deployment Database

Sean Cull — Sun, 16 Oct 2011 11:39:46 +0100

It has turned out to be one of those frustrating weekends where servers simply do very odd things ( no css but just on ios devices and on 2 x 853 servers - weird - solved by a full rebuild of the servers ) and the IBM technotes are all 404 ( sounds like a typical weekend you say ).

One of the nice discoveries has been this wiki article from Paul Hannan of IBM about the new way to deploy the Extension Framework.

#####

This is where the bloody gremlins are striking again, I have added this link umpteen times and the = always gets corrupted to �. I even created a new post - somebody has it in for me this weekend !

try this => http://goo.gl/MQGHD

#####

Anyhow, there was previously a project by Stephan Wissel and co and the documentation for the Latest 853 extension framework still says that you must drop the files to the server manually but there is an officially supported application bundled with 853.

A couple of things to watch :

Note to those ( like me ) not familiar with plugins. When you upload site.xml you must do it from an folder that also contains the other elements of the zip that it came in e.g extract the contents of updateSite.zip to a folder and THEN upload site.xml.
You do not get an error message if the files referenced inside site.xml cannot be found e.g.

The ini setting cannot be changed via the console. You must edit the ini file manually - not sure why and it seems like an impediment to deployment.

Is your VMWare Workstation network really slow ?

Sean Cull — Sat, 15 Oct 2011 18:37:40 +0100

My VMware desktop system has almost ground to a halt, replicating a 40MB database tot he virtual server was taking 1.5 hours.

I came across this post ( item 30 ) and now it takes seconds, basically turn off anything to do with Large Offloads and Jumbo Frames.

?" border="0" src="http://www.seancull.net/public/seancull.nsf/dx/is-your-vmware-workstation-network-really-slow-solved-.htm/content/M2?OpenElement" />

Apache XPages Survey Applications

Sean Cull — Sat, 15 Oct 2011 00:25:57 +0100

At FoCul we have been doing quite a bit of XPages work, The single biggest enabler for us has been the generosity of the Lotus community in posting Blogs, Open Source Projects and tutorials - we simply couldn't have done it without the community.

I work with an excellent developer called Andrew Champion. About 6 months ago we developed an XPages based web survey tool as a commercial product. We wrote it from scratch but it was inspired by the early XPage articles from John Mackay.

We are releasing three versions of the application :

A Pro version
A free Lite version
An Apache Open Source Version

You can see more on our web site , try a demo here and download a copy at OpenNTF.

Let us know what you think.

Our latest XPage project

Sean Cull — Mon, 3 Oct 2011 07:53:21 +0100

Some of you may have seen me present on the ABB Risk Based Inspection System that FoCul have developed and maintained ABB over the last 10 years. It has been fantastically successful and has contributed over $3 million to efficiency savings for ABB and their customers.

ABB have recognised the additional benefits that XPages can bring and we are now working on a new version of the application. The reason for the move to XPages included :

> A much more modern look and feel
> The ability to bring customers in via a browser offering and still use local replicas
> Multilingual capabilities
> Configurable forms
> In-line charting
> Reduction in replication conflicts through using multiple data sources on forms

There are certainly some challenges along the way but it will be a great system and will give us some great things to blog about.

The XWork server announced by Ed Brill will also be a very useful tool in allowing ABB to deploy this product to their customers as intranet applications.

In the past exploratory discussions around the opportunity to do this kind of thing were always couched in vague terms and we had to work very hard not to confuse the line of business users with "virtual servers" and the dreaded PVU.

Now it is simple - yes absolutely Mr Customer, your customers can run this application platform on their site with no restrictions for about $2000 per year - it doesn't get much simpler than that.

p.s. thanks to the XPages team for speeding up XPages in the Notes Client in 8.5.3, the project wouldn't have flown without that.

7 Steps to making the new XPages Wiki simpler ( about an hour )

Sean Cull — Thu, 15 Sep 2011 19:03:39 +0100

The "new" XPages wiki on Openntf ( known as the Xpage Documentation Wiki ) has some useful improvements over the older version but the tailoring for its use in the IBM product Wikis has also made it more complicated. This is a very quick article showing how it can be simplified so that it is easier to use for general projects etc..

The end result

Step 1 - Hide the media gallery if you don't want it

Step 2 - Hide the extra tabs at the top

These are quite clever but too complicated for this use case

Step 3 - Change the Go Elsewhere Footer

This has a complicated "hide - when" on it. delete the computed fields and replace them with links. You can copy the ones from the adjacent panel but remember that the individual links have hide-when properties too.

Step 4 - Change the default opening page for the web

Step 5 - Hide the company contributors panel

Step 6- Correct a bizzare URL issue

This one stumped me.
When you click on a new document link within the body of a document i.e. [[document name]] where document name does not yet exist, it was trying to open a wiki at the URL /dwlhub.swg.usma.ibm.com. I cannot find this anywhere in the design or in the profile documents.
The problem also affects the plus.gif icon
The changes to the code below solve the problem. Judging by the print statements I am not the first to have had this problem.

Step 7 - Correct a missing MenuUtility.js file

This js file is not used and does not exist but it is down as a resource on two custom controls. If you check Firefox you will see that it is generating an error.
Remove the references

SNTT : Pulling Notes data into Excel via http / XML

Sean Cull — Mon, 5 Sep 2011 22:51:45 +0100

Just a very quick tip to show how you can dynamically pull your latest Notes / Domino data into an Excel Spreadsheet.
Note that this method will only work for domino applications which do not require authentication

Basic Idea

In Excel go to Data and click on the Data and then "From Web" options

Next paste in the URL of your Domino XML feed ( more on that later )

Accept all of the options and your data will be added in a nicely formatted table.
The table is also given a name so that when you reference it from pivot charts etc.. the chart will always contain all of the data from the XML feed.

Creating the XML Feed

I knocked up a simple agent that will generate XML based on a search string or a view name and some other configuration.
The code is not great and should really have been done using classes but it works well enough. I have attached a demo database to the end of this article.

The config looks like this :

selection##view##vActionsAll##
reference##field text##Reference_Tx##TBA
days_old##field delta date days##IssuedDate_Tx##@now
unid##formula##docalcres = "this bit is calculated => " + doc.universalid##

The construction of the configuration varies. For line 2
part1 = XML property name
part2 = "the method"
part3 = the Notes filed name
part4 = the value to publish if the field name is empty

for line 3
part1 = XML property name
part2 = "the method"
part3 = the first date
part4 = the second date

for line 4
part 4 is a lotusscript expression that will be evaluated.

You can see the output here :
http://deliverytoolkit.com/public/fdt/moc/mocdemo.nsf/xmlagent?openagent&XML_Feed_Test

Numbers as text and modifying the schema

Although Excel is very clever in automatically generating a schema for the XML feed it does not allow you to edit it. This is where the new .xlsx format comes into its own.

If you change the .xlsx to .zip you can open the Excel file and modify the schema.

Note : you will need to delete the affected column in Excel and re-create it for the new schema to kick in

Thanks to Gary Devendorf

I have been using variations of this technique for some time. The idea originally came from Gary Devendorf who has published examples of how it can be done with earlier versions of Excel.

Download

The download link is below. You can see examples of the same database here :
http://seancull.co.uk/public/examples/SC/XML_Excel_Demo.nsf/xmlagent?openagent&XML_DEMO_View

XML_Excel_Demo_Download.zip
Book1.xlsx

Thank you to Tim Tripcony and the XCast and how XPages is going for me

Sean Cull — Sat, 13 Aug 2011 20:59:38 +0100

During a recent XCast podcast Tim Tripcony said some very powerful stuff about how in the Lotus ( or whatever we are called ) community we all benefit from each others contributions via blogs, forums, LUGs etc..

Heres a short clip, I hope the guys don't mind. clip.mp3

I started this blog in 2009 because I felt that I needed to give back to the community for the great help that I have received in building my Notes skills, my company and providing for my family.

A large part of my less frequent blogging has been due to how successful XPages has been for myself and my colleagues. It has allowed us to take on new customers, to reinvigorate existing customers and to enjoy the excitement of learning a new skill and sharing the vibe in the community that new challenges create. It has been hectic and blogging had, until now, dropped off the list.

None of this success would have been possible without the tremendous contributions that the community has made in terms of showing each other what can be done with XPages - the Custom Controls competition has been a great example of that.

Tim ( and Paul's ) comments have reminded me of how much I have gained from the community blogs and how important it is that I continue to blog.

Another thing that has re-invigorated my energy to blog is IBMs decision to share the presentations form LS11. IBM do a great deal to support the community though OpenNTF but withholding very useful enabling information from their own developer community just rubbed me up the wrong way - I am not sure if that was a common or justified reaction but it was how I felt.

So going forward I will endeavour to ensure that our success with XPages does not get in the way of repaying my debt to the community by sharing what I have learnt along the way.

Active Directory / Domino Authentication - easy but not easy enough

Sean Cull — Sat, 16 Jul 2011 09:33:42 +0100

I have been working on a scheme to use Active Directory LDAP authentication for an XPages App. I posted about my early experiences with it here - everything seemed very promising but actually putting it into production has proved quite difficult. The scheme is based on dual entries in the AD Directory and the Domino Directory which are kept in sync by an agent. This is running on an XPages appliance with no day to day local IT involvement.

The difficulty comes from mapping user names from AD to Domino in a useful way.

A typical AD Distinguished Name looks like this CN=Sean Cull/OU=Users/OU=SiteA/OU=Resources/DC=acme-uk/DC=acme/DC=local

The directory assistance document allows you to map which AD field you want to use as the Notes Distinguished Name but you can only use an existing AD Attribute as opposed to constructing a mapping scheme e.g. name & "/OU=some OU"..... Effectively this means choosing one of the following :

CN=Sean Cull//OU=Users/OU=SiteA/OU=Resources/DC=acme-uk/DC=acme/DC=local
Sean Cull
CullS

Only the first option is acceptable because you can easily get two people with the same name but from different OUs.

Because Notes does not seem to regard the CN=xxx.....DC=acme as a fully hierarchical name ( because of the DC element ? ) the abbreviated name function does not work although the Common Name does. In many of our applications we would display names in the format Sean Cull/FoCul to give some protection against people from different OUs having the same name - with Domino authentication we could do this by computing a display name from the full name.

To achieve the same thing with AD authentication we have to maintain a document which maps the actual username to a display name and a set of parallel fields on the forms for the real names and the display names.

This solution is manageable but it would be so much nicer to be able to map the AD name to a different name structure in the Domino NAB.

From the users perspective it is great though, they just log into the application with their usual name and password.

IT love it too because it is one less thing to worry about.

As solution providers we love it because it is one less barrier to getting appliance based XPage applications into non-domino shops or ex-domino shops.

Be thankful for Notes / Domino backward compatibility

Sean Cull — Sat, 18 Jun 2011 08:14:12 +0100

At one point about 6 years ago we had looked at developing part of the business around using opensource systems like Joomla for collaborative applications ( the push being a frustration with IBM licensing ). We set up some sites for local charities as a way of dipping our toe in the water.

All my spare time ( and more ) is now going into fixing these charity websites that we set up and support for free or for a nominal fee - its a bit of a nightmare really :-(

The sites are on a version Joomla ( originally Mambo ) which is no longer compatible with the version of PHP that the web hosting provider has upgraded to and they have all fallen over.

The learning that we took away fairly quickly ( and hence stayed with Domino ) was that managing the core opensource module and the different plugins connected to that module is very difficult, particularly where each project was bespoke

The key issues were :

>>>Upgrades to the core Joomla / Mambo system would sometimes break the separate opensource extensions.

>>>In many cases the upgrade cycle of the extensions lagged behind the core Joomla upgrades.

>>>Backward compatibility was not a high priority in the project with 3 significant changes in architecture.

>>>The opensource project forked at one point ( the Joomla / Mambo split ).

>>>Hacking was a more difficult issue to manage than on a Domino platform

The Joomla project is hugely impressive. What has been achieved by this opensource project is just amazing and I still remember the first time I looked at the Joomla Application Control Panel thinking that if we had been asked to write it from scratch it would have been a �100,000 +project. Having said that in Domino land we simply don't have to worry about most of the above issues - we have Notes 4 apps running very happily ( robust and secure ) on Domino 8.5**.

Drupal is another popular opensource platform - here is there statement on backward compatibility :

"people adopting Drupal for their web or CMS project should plan for periodic upgrades of their project to the latest major release (every 12-24 months) in order to benefit from the ongoing active support of one of the finest open source development communities. "

As a design house with 90% of our work being bespoke and 500+ applications in production that is just plain scary.

Its also interesting that now that I have to move these applications to a new version of Joomla ( Domino is still not a viable option ) I am having to pay for most of the extensions that I need to use. I am not sure how much of this shift is driven by people seeing a business opportunity and how much is by people needing a better level of service for the reasons above.

The lesson I take away from all this is be grateful for the backward compatibility of Domino - I know it might hold the product back and can't last forever but for now you probably have no idea how valuable it is.

** I guess that there was the occasional issue around security and new features such as readviewentries.

IBM’s XPages App Server Dilemma - a faster horse, a cash cow or a compelling new concept ?

Sean Cull — Tue, 31 May 2011 07:00:00 +0100

"If I asked my customers what they wanted they would have said a faster horse" - Henry Ford

Introduction

I try to keep opinion out of this blog and stick to techie stuff but Ed Brill has tweeted encouraging more discussion on this topic so here goes.

In my world XPages has been the best thing to come to Notes / Domino since the product since embedded views were added. It has the potential to give Notes / Domino a new lease of life as an application development platform. In my opinion two things are holding it back. The first is a critical mass of developers and users. The second is an attractive licensing model for ISVs and net new customers.

I think that IBM faces a dilemma with the new XPages Application server licence. The new licence will invariably lead to some organisations leaving the full Notes product and licensing for applications only - these companies have probably already moved to exchange for mail and are essentially taking notes maintenance just for applications. If the GBS Transformer product is successful this will add further organisations to this pool.

Conversely if IBM can fully tap into the potential of XPages with an attractive licence they can expand their licence sales to the point where the net benefit is positive and the future is brighter.

IBM is listening

I genuinely believe that IBM is listening very hard. Myself and some other Lotus advocates got talking on this issue at UKLUG and Ted Stanton very kindly fed our views back to Ed and his colleagues. The next day they phoned me to understand our concerns better. I put my thoughts to them in a note which was very similar to the views I am sharing below :

Background

I run FoCul which is a Notes / Domino development shop based in the UK. Our target market is the manufacturing sector and traditionally we have been restricted to working with manufacturing organisations who already ( wholeheartedly ) support a Notes infrastructure. This market is rapidly shrinking in the UK.

Recently we have had some good success offering XPages Apps on virtual Domino Appliances to some ex Notes ( no current maintenance ) and non Notes shops and there is interest from more. We use an ASL Licence. The process to get this licence was difficult.

Every prospective customer we talk to already has a fully licensed .Net / SQL infrastructure and a SharePoint install of some kind. We believe our edge is primarily our industry knowledge / solutions and then, to a lesser extent, our choice of XPages as a solution platform - frankly we would have a much easier sell if we used .Net and made it seem like SharePoint ( as in a Ford is a much easier sell than a Lexus to most car owners ).

My opinion on the importance of an Application Server

This is the last chance for IBM to stop Domino disappearing as a supported development platform from all but a few large organisation sin the UK. This window of opportunity is rapidly closing. There are a number of schemes that IBM could adopt but at the extremes these are :

1) An initiative to make XPages "go viral". Free to small organisations or lightly loaded servers ( with no IBM support ) , attractive pricing, boost the pool of developers.

2) To treat XPages as a cash cow while IBM makes the most of the legacy curve that Notes / Domino is progressing along in the eyes of many CXO's.

Option 1) has been mooted for some time and has gained very little traction. I would be naive to think that it is easy to get anything to go viral and I know that there would be no marketing by IBM. There are other Community editions of IBM products and Microsoft apparently offers free SQL servers for smaller databases ( <10GB ). IBM also offers DB2 Express for free although it is hard to understand what the costs for Websphere Application Server Community Edition are.

I would love this to happen and in reality IBM gets little or no revenue from the 95% of companies in the UK that have less than 20 employees - yes that is a true statistic.

Option 2) must surely be tempting to IBM. An XPages appliance server would free some organisations of the handcuffs that keep them on Notes maintenance even though they have moved to Exchange for mail. A licence of say USD 50 per person might make it attractive for those companies to move Apps to XPages ( I have my doubts about Transformer but that's a whole different issue ) but a USD 50 per person charge levied on all users would kill a lot of possible projects - particularly where the users were customers of an organisation rather than employees.

As Vowe recently commented - If Henry Fords had asked his customers what they wanted they would have replied "a faster horse". Similarly I don't recall anyone in the yellowsphere asking for Workplace Component Designer to be re-badged as XPages and added to Domino.

IBM has shown that it can wow its customers with a compelling new concept rather than a faster horse.

A word of caution though, positioning the XPages application development platform as part of the bigger "Social" initiatives in IBM will not increase its perceived worth amongst my customer base.

What I want from an Application Server

Appliance based solution

I want to be able to provide appliance based solutions to organisations of all sizes where the pricing is about the numbers of people using the applications rather than the ultimate size of the legal entity.

Example : I want to be able to sell a 50 user application to "MegaCorp" and then hopefully sell the same solution again to other sites in MegaCorp
In reality each site will probably want their own appliance but if they wanted one central appliance I do not have a problem with the notion that multiple sells of our solution should also mean multiple sells of the underlying IBM platform.

While I have mentioned the number of users as being important I am not a fan of absolute per user pricing because I want as many users as possible to use our applications because that is what makes them sticky in the organisation - but - the design of the application means that the client will not want to try and use it for more than one site because they will deliberately want to silo those work processes and knowledge to keep them manageable => you will not get the case that MegaCorp will run everything globally through one instance of our application on a 100pvu IBM licence. Bands of users might be a solution i.e. 0 - 50, 50 - 100 etc..

The PVU thing is a real issue, per socket would seem better although I am not an expert on this ( and more to the point neither are my customers ).

I believe that 100 PVUs is adequate for most of our projects assuming a server instance per sell. Where multiple sells used the same server more power would result in more PVUs. Equally a limit on the number of application databases could also drive this additional sell to IBM.

The same solution as SAAS

I want to be able to do the above as SAAS
In our case we could manage with a separate server instance per customer but to be able to serve different customers on the same server instance ( multi tenanted ? ) would also be attractive - they have no access to the nab nor any need for it.

The above with a mixture existing Notes users ( fully licensed on maintenance ) and non notes users

I have several opportunities at the moment where we would like to propose an XPages stand-alone application to manage training records for an organisation where 75% of the users already have Notes licences. There is no prospect of the remaining 25% being put on Notes as they are production line workers.

I would like to be able to sell an appliance / XPages / browser based solution that covered 100% of the workforce ( about 500 people ). It would be useful if that appliance were allowed to replicate back to the existing enterprise servers so that the HR department could use the rich client to look at the data or for the 75% of users with Notes licences to use XPages in the client to work with the system.

The above with an RDBMS back end

When functionality to integrate XPages with RDBMS becomes available ( it has been suggested that something will appear on OpenNTF as part of the extension library ) it would be very useful to be able to bundle a simple RDBMS with the server. As a rule of thumb we will not use Notes if there are more than 100,000 records in a database. For something like a training history system we would like to use a RDBMS for the simple transactional data.

The above with no impediment to external users

The difference between internal and external users is becoming more and more blurred in business. I need the ability for customers to bring their customers an suppliers into these processes in a simple way. At the same time it would be good to realise that organisations are not willing to pay a per head charge for large number of customers to be brought into their systems for simple tasks - yes I know these two things are a contradiction !

Integration into AD authentication

AD authentication will be the de facto authentication method for employees in white space projects. This needs to be included. I don't think TDI is relevant ( too complex ) but LDAP seems to work OK in the trials we have done.

Anonymous usage

All forms of licence need to allow this

XPages in the Client ( XPiNC)

Replication is still a key selling point for us but it is usually for a subset of the users. I believe that users with a full client licence should be able to use the same server for XPiNC.
I would also love an XPiNC client that was not Lotus Notes and did not have all the other stuff that you get with a Notes install - just an XPages run time.

Choice of OS

I absolutely understand that IBM will not offer support if we build the appliances on Ubuntu / CentOS but this should not be a licence constraint.

I don't think that Amazon EC2 is that useful in this space, the sizing bands are not a good fit with Domino ( in my opinion ) and there are cheaper alternatives.

The use of virtualised servers must be supported

The requirements imposed by sub capacity licensing are much too onerous and confusing

Thoughts on the mechanics of licensing

I would be very happy ( would very much prefer even ) to have limiting controls built into the server rather than written constraints in the written licence terms.

These could include concurrent users, named users, numbers of databases, size of databases, processors.

I am conscious that this brings its own problems as we saw when Ed looked at the artificial differences between express and enterprise.

What actually happens when a limit is met is also interesting - slowing the server down without a clear indication to the users of why it has been slowed could easily back fire.

My thoughts on each of the above

concurrent users :
A scheme whereby more users cannot log on until some have left
There would need to be a very clear explanation to the users
Developers may have to change apps to deal with this

named users :
I personally don't like charging per user because it adds bureaucracy and can prevent an application from reaching critical mass.
If the licence was relatively cheap then bands of users ( 0 - 10, 10 - 50 etc ) might work but I am still not keen

numbers of databases:
This could work but it would need to be built into the system as a real constraint rather than a terms of usage
We would typically have 3/4 databases per sell.
The Application
An Archive
A reporting Tool
Sometimes we also have a large object store

We are also asked for test and training environments which would mean another 1 or 2 sets of databases on that server associated with that single sell.
Need to watch out for things like temporary restores

Size of databases:
Apparently MS does this
Difficult one as things like the Full Text Index will affect it
Views alone can often take up 30 - 60 % of a database size - what happens if someone opens a view for the first time ?
How will users know that a limit has been reached ?
What is the warning mechanism as the threshold is approached ?

Power of server:
I think the whole PVU thing is mad but I can see that server power is important.
A socket based system ( like Websphere community edition ) would be OK but I would much rather have some internal server mechanism to throttle performance so that customers could use whatever hardware they chose to.
Any system needs to be applicable to virtual servers
I firmly believe that IBM should not restrict our ability to run servers on Ubuntu CentOS via licensing constraints - by all means refuse support but licensing should be separate.
The requirements imposed by sub capacity licensing are much too onerous and confusing

Your Thoughts

I am not sure how typical my point of view is. Please add your own comments below or contact Ed Brill with your views if this is important to you.

Visit us at LCTY or complete our web survey for the chance to win an iPad 2

Sean Cull — Tue, 12 Apr 2011 07:39:49 +0100

I've been working flat out to get ready for LCTY at Warrington. Come by our booth ( FoCul Ltd ) to say hello and enter our prize draw for an iPad 2.

If you can't make the event then you can enter via our on-line survey.

We have some great offers including a free copy of our new XPages Web Survey tool and an offer on �999 Proof of Concepts for XPages.

www.move-to-xpages.com

XPages Web Survey Tool

Sean Cull — Wed, 23 Mar 2011 17:16:00 +0100

We have been working on a new XPages web survey product.

There will be three versions. A Full version, a "Lite" version and an open source version which we will release via Open NTF under the Apache licence.

Let us know how you find it, all feedback heartily received ( even about IE6 ! )

FoCul Delivery Toolkit Web Survey Beta

Thanks, Sean

Update for Patrick

The screen shot below is from the configuration record for a question. The questions are defined separately so that they can be re-used across multiple surveys. This reduces translation costs and also allows the same answers to be aggregated across multiple surveys.

full res image

Golf W446NLK for sale

Sean Cull — Tue, 15 Mar 2011 21:12:50 +0100

If you are interested in a pre-loved Golf GTI then see here => http://w446nlk.co.uk/

2000 (W reg)
Hatchback
70,400 miles
Manual
2.0L
Petrol

70,400 miles, Excellent Condition, 2 owners - mother and daughter - from new, 5 Doors, Manual, Hatchback, Petrol, 70,400 miles, 12mths MOT, full service history, new tyres, air conditioning, Radio, CD Changer, 4 x electric windows, drivers armrest, heated electric door mirrors, height adjustable drivers seat, passenger airbag, side airbags, rear headrests, alloy wheels, Immobiliser, ABS, Full size spare wheel, Remote central locking, Body coloured bumpers, Rear armrest, PAS, no accidents - see for more info. �2,400 No canvassers or agencies.

SNTT : Using Active Directory to authenticate web users

Sean Cull — Thu, 10 Mar 2011 21:24:59 +0100

Introduction

This article describes how you can use Active Directory via LDAP and Directory Assistance to authenticate your web users. This is particularly useful in our case where we have an XPages based application running in on a black boxed appliance in a MS shop.
The example uses a Windows Server 2008 R2 for AD and Domino 8.5.2 running on Linux. The scheme is simple enough but I struggled to piece the bits together so I thought a write up would be useful.

Useful tools

I found that the Apache Directory Studio was really useful. This allows you to explore the Active Directory LDAP feed and get a feel for its structure.

Useful debugging parameters

I found the following two parameters very useful because you can see the structures of the names and groups in AD as they are queried by Domino - these settings are for temporary use only as they create overhead and also show users passwords on the console in plain text ( somewhat disconcerting )

Webauth_verbose_trace=1
LDAPDEBUG=1

Setting up an AD test environment

This was very straight froward. I installed a 2008 R2 server as a VM and used the Server Roles Manager wizard to install Active Directory accepting the defaults and dependencies.
I then created a new user ( joe bloggs ) and used that account to authenticate the LDAP feed.

Exploring the LDAP Feed with Apache Directory Studio

Use File New and then choose LDAP Connection

Press the check Authentication button and all should be well

Next you can browse the LDAP tree and see information on the users and groups

The equivalent "Notes name" as used in an ACL would be

CN=joe bloggs/CN=Users/DC=ad/DC=focul/DC=net

Configuring Domino to use the Active Directory LDAP

You need to create a Directory Assistance Database and then list this in the server record
The directory assistance template is an advanced template called called Directory Assistance ( da.ntf )

The server document entry looks like this

In the Directory Assistance Database create a record as follows.

Note that Gabriella Davis and Marie Scott on page 20 of their very useful presentation One DirectoryTo Rule Them All, Yes suggests encrypting the LDAP configuration document - not sure how to do that just yet.

Note that the suggest and verify buttons are very useful, particularly for the Base DN for search

Testing Authentication

Start with the most basic example you can.
With a test database set anaonymous access to No Access and Default Access to reader or higher.

Open the URL and attempt to login - in my case as Joe Bloggs. In the console you will see something similar to this :

Your authentication is working.

You can now test it with a specific name. You can see the shape of the name from the console output

The AD name CN=joe bloggs,CN=Users,DC=ad,DC=focul,DC=net gets mapped to CN=joe bloggs/CN=Users/DC=ad/DC=focul/DC=net for use in the ACL
Groups also work but note that if you put a group into the AD as a peer of "Users" the group name construct includes "Builtin" as in CN=testgroup/CN=Builtin/DC=ad/DC=focul/DC=net so it is better to put the groups within the users branch.

In our case the group name is CN=testgroup4/CN=Users/DC=ad/DC=focul/DC=net

Further Integration

This OpenNTF Active directory name picker project and search by Rishi Sahi looks really interesting. He also has some good blog articles on LDAP integration

A mild rant

In pulling this material together I have come to the conclusion that it is a real shame that IBM has not published the slide decks from lotussphere 2011.

It would make it a lot easier for developers to make the IBM products more popular if IBM as an organisation was a good citizen of the community in that respect.

I have huge admiration for many individuals within IBM that do their best despite IBM in this regard. I also think it is unfair to expect the community to contribute to the IBM Wikis when they are sitting on hundreds of excellent presentations by the world experts in this area - experts who gave up thousands of hours to prepare those slide decks.

Its hardly what I would describe as a good example of a Social Business.

SNTT : Using Active Directory to authenticate web users

Sean Cull — Thu, 10 Mar 2011 21:24:59 +0100

Introduction

Useful tools

I found that the Apache Directory Studio was really useful. This allows you to explore the Active Directory LDAP feed and get a feel for its structure.

Useful debugging parameters

Setting up AD

This was very straight froward. I installed a 2008 R2 server as a VM and used the Server Roles Manager wizard to install Active Directory accepting the defaults and dependencies.

Exploring the LDAP Feed with Apache Directory Studio

Configuring Domino to use the Active Directory LDAP

Testing Authentication

Further Integration

This OpenNTF Active directory name picker project and search by Rishi Sahi looks really interesting. He also has some good blog articles on LDAP integration

Sean Cull

Please don’t be shy at Lotusphere

Can I ask all of you who are lucky enough to be at Lotusphere one favour ?

Please don't be shy.

Have a think about what the top 5 things you would ask for would be AND why.

Oh, and one last thing, make sure you tell them the 5 best things that they have already given you !

Configurable low overhead scheme for date dependent colour coding in views

1) the column formula. The image below shows it in the configuration document.

2) The column in the view.

3) The Scheduled Agent

So how do you open an xpage in a different database in XPINC ?

How it works when everything is in the same database

The problem with data sources from other Notes databases

1) You can modify the underlying form associated with the XPage so that if the document is called then it will automatically be presented as the relevant XPage

2) You could call the XPage using the following construct

3) You could use a non rendering XPage with a "before render" script to redirect to the correct document.

Some Observations

I am very honoured to be an IBM Champion

What advice would you give a MAC newbie ?

New IBM supported XPages Extension Framework Deployment Database

Is your VMWare Workstation network really slow ?

Apache XPages Survey Applications

Our latest XPage project

7 Steps to making the new XPages Wiki simpler ( about an hour )

The end result

Step 1 - Hide the media gallery if you don't want it

Step 2 - Hide the extra tabs at the top

Step 3 - Change the Go Elsewhere Footer

Step 4 - Change the default opening page for the web

Step 5 - Hide the company contributors panel

Step 6- Correct a bizzare URL issue

Step 7 - Correct a missing MenuUtility.js file

SNTT : Pulling Notes data into Excel via http / XML

Basic Idea

Creating the XML Feed

Numbers as text and modifying the schema

Thanks to Gary Devendorf

Download

Thank you to Tim Tripcony and the XCast and how XPages is going for me

Active Directory / Domino Authentication - easy but not easy enough

Be thankful for Notes / Domino backward compatibility

IBM’s XPages App Server Dilemma - a faster horse, a cash cow or a compelling new concept ?

Introduction

IBM is listening

Background

My opinion on the importance of an Application Server

What I want from an Application Server

Appliance based solution

The same solution as SAAS

The above with a mixture existing Notes users ( fully licensed on maintenance ) and non notes users

The above with an RDBMS back end

The above with no impediment to external users

Integration into AD authentication

Anonymous usage

XPages in the Client ( XPiNC)

Choice of OS

Thoughts on the mechanics of licensing

Your Thoughts

Visit us at LCTY or complete our web survey for the chance to win an iPad 2

XPages Web Survey Tool

Golf W446NLK for sale

SNTT : Using Active Directory to authenticate web users

Introduction

Useful tools

Useful debugging parameters

Setting up an AD test environment

Exploring the LDAP Feed with Apache Directory Studio

Configuring Domino to use the Active Directory LDAP

Testing Authentication

Further Integration

Other useful presentations

A mild rant

SNTT : Using Active Directory to authenticate web users

Introduction

Useful tools

Useful debugging parameters

Setting up AD

Exploring the LDAP Feed with Apache Directory Studio

Configuring Domino to use the Active Directory LDAP

Testing Authentication