meillo@58: .H0 "Discussion
meillo@0: .P
meillo@58: This main chapter discusses the practical work done in the mmh project.
meillo@104: It is structured along the goals to achieve.
meillo@104: The concrete work done
meillo@58: is described in the examples of how the general goals were achieved.
meillo@87: The discussion compares the current version of mmh with the state of
meillo@87: nmh just before the mmh project started, i.e. Fall 2011.
meillo@87: Current changes of nmh will be mentioned only as side notes.
meillo@87: .\" XXX where do I discuss the parallel development of nmh?
meillo@58: 
meillo@58: 
meillo@58: 
meillo@100: .H1 "Stream-Lining
meillo@58: 
meillo@0: .P
meillo@58: MH had been considered an all-in-one system for mail handling.
meillo@58: The community around nmh has a similar understanding.
meillo@87: In fundamental difference, mmh shall be a MUA only.
meillo@87: I believe that the development of all-in-one mail systems is obsolete.
meillo@87: Today, email is too complex to be fully covered by single projects.
meillo@87: Such a project won't be able to excel in all aspects.
meillo@87: Instead, the aspects of email should be covered my multiple projects,
meillo@87: which then can be combined to form a complete system.
meillo@87: Excellent implementations for the various aspects of email exist already.
meillo@87: Just to name three examples: Postfix is a specialized MTA,
meillo@87: Procmail is a specialized MDA, and Fetchmail is a specialized MRA.
meillo@89: I believe that it is best to use such specialized tools instead of
meillo@87: providing the same function again as a side-component in the project.
meillo@58: .P
meillo@87: Doing something well, requires to focus on a small set of specific aspects.
meillo@87: Under the assumption that focused development produces better results
meillo@100: in the particular area, specialized projects will be superior
meillo@87: in their field of focus.
meillo@87: Hence, all-in-one mail system projects \(en no matter if monolithic
meillo@87: or modular \(en will never be the best choice in any of the fields.
meillo@87: Even in providing the best consistent all-in-one system they are likely
meillo@87: to be beaten by projects that focus only on integrating existing mail
meillo@89: components to a homogeneous system.
meillo@87: .P
meillo@87: The limiting resource in Free Software community development
meillo@87: is usually man power.
meillo@87: If the development power is spread over a large development area,
meillo@87: it becomes even more difficult to compete with the specialists in the
meillo@87: various fields.
meillo@87: The concrete situation for MH-based mail systems is even tougher,
meillo@87: given the small and aged community, including both developers and users,
meillo@87: it has.
meillo@87: .P
meillo@87: In consequence, I believe that the available development resources
meillo@100: should focus on the point where MH is most unique.
meillo@87: This is clearly the user interface \(en the MUA.
meillo@87: Peripheral parts should be removed to stream-line mmh for the MUA task.
meillo@60: 
meillo@60: 
meillo@100: .H2 "Mail Transfer Facilities
meillo@60: .P
meillo@60: In contrast to nmh, which also provides mail submission and mail retrieval
meillo@87: agents, mmh is a MUA only.
meillo@100: This general difference initiated the development of mmh.
meillo@66: Removing the mail transfer facilities had been the first work task
meillo@76: in the mmh project.
meillo@60: .P
meillo@105: Focusing on one mail agent role only is motivated by Eric Allman's
meillo@105: experience with Sendmail.
meillo@105: He identified limiting Sendmail the MTA task had be one reason for
meillo@105: its success:
meillo@105: .[ [
meillo@105: costales sendmail
meillo@105: .], p. xviii]
meillo@105: .QS
meillo@105: Second, I limited myself to the routing function \(en
meillo@110: I wouldn't write user agents or delivery back-ends.
meillo@105: This was a departure of the dominant through of the time,
meillo@105: in which routing logic, local delivery, and often the network code
meillo@105: were incorporated directly into the user agents.
meillo@105: .QE
meillo@105: .P
meillo@105: In mmh, the Mail Submission Agent (MSA) is called
meillo@105: \fIMessage Transfer Service\fP (MTS).
meillo@105: This facility, implemented by the
meillo@105: .Pn post
meillo@105: command, established network connections and spoke SMTP to submit
meillo@60: messages for relay to the outside world.
meillo@105: The changes in email demanded changes in this part of nmh too.
meillo@89: Encryption and authentication for network connections
meillo@87: needed to be supported, hence TLS and SASL were introduced into nmh.
meillo@87: This added complexity to nmh without improving it in its core functions.
meillo@87: Also, keeping up with recent developments in the field of
meillo@87: mail transfer requires development power and specialists.
meillo@87: In mmh this whole facility was simply cut off.
meillo@76: .Ci f6aa95b724fd8c791164abe7ee5468bf5c34f226
meillo@76: .Ci fecd5d34f65597a4dfa16aeabea7d74b191532c3
meillo@76: .Ci 156d35f6425bea4c1ed3c4c79783dc613379c65b
meillo@87: Instead, mmh depends on an external MSA.
meillo@60: The only outgoing interface available to mmh is the
meillo@60: .Pn sendmail
meillo@87: command, which almost any MSA provides.
meillo@87: If not, a wrapper program can be written.
meillo@87: It must read the message from the standard input, extract the
meillo@87: recipient addresses from the message header, and hand the message
meillo@87: over to the MSA.
meillo@87: For example, a wrapper script for qmail would be:
meillo@87: .VS
meillo@87: #!/bin/sh
meillo@87: # ignore command line arguments
meillo@87: exec qmail-inject
meillo@87: VE
meillo@87: The requirement to parse the recipient addresses out of the message header 
meillo@87: is likely to be removed in the future.
meillo@87: Then mmh would give the recipient addresses as command line arguments.
meillo@100: This appears to be the better interface.
meillo@87: .\" XXX implement it
meillo@60: .P
meillo@60: To retrieve mail, the
meillo@60: .Pn inc
meillo@100: command acted as Mail Retrieval Agent (MRA).
meillo@100: It established network connections
meillo@76: and spoke POP3 to retrieve mail from remote servers.
meillo@76: As with mail submission, the network connections required encryption and
meillo@87: authentication, thus TLS and SASL were added.
meillo@87: Support for message retrieval through IMAP will become necessary
meillo@100: to be added soon, too, and likewise for any other changes in mail transfer.
meillo@100: Not so for mmh because it has dropped the support for retrieving mail
meillo@100: from remote locations.
meillo@76: .Ci ab7b48411962d26439f92f35ed084d3d6275459c
meillo@76: Instead, it depends on an external tool to cover this task.
meillo@100: In mmh exist two paths for messages to enter mmh's mail storage:
meillo@100: (1) Mail can be incorporated with
meillo@60: .Pn inc
meillo@87: from the system maildrop, or (2) with
meillo@60: .Pn rcvstore
meillo@87: by reading them, one at a time, from the standard input.
meillo@60: .P
meillo@60: With the removal of the MSA and MRA, mmh converted from an all-in-one
meillo@87: mail system to being a MUA only.
meillo@60: Now, of course, mmh depends on third-party software.
meillo@87: An external MSA is required to transfer mail to the outside world;
meillo@60: an external MRA is required to retrieve mail from remote machines.
meillo@60: There exist excellent implementations of such software,
meillo@76: which do this specific task likely better than the internal
meillo@87: versions had done it.
meillo@87: Also, the best suiting programs can be freely chosen.
meillo@60: .P
meillo@60: As it had already been possible to use an external MSA or MRA,
meillo@60: why not keep the internal version for convenience?
meillo@76: The question whether there is sense in having a fall-back pager in all
meillo@76: the command line tools, for the cases when
meillo@60: .Pn more
meillo@60: or
meillo@60: .Pn less
meillo@76: aren't available, appears to be ridiculous.
meillo@100: Of course, MSAs and MRAs are more complex than text pagers
meillo@87: and not necessarily available but still the concept of orthogonal
meillo@87: design holds: ``Write programs that do one thing and do it well.''
meillo@87: .[
meillo@87: mcilroy unix phil
meillo@87: p. 53
meillo@87: .]
meillo@87: .[
meillo@87: mcilroy bstj foreword
meillo@87: .]
meillo@87: Here, this part of the Unix philosophy was applied not only
meillo@87: to the programs but to the project itself.
meillo@87: In other words:
meillo@87: ``Develop projects that focus on one thing and do it well.''
meillo@87: Projects grown complex should be split for the same reasons programs grown
meillo@87: complex should be split.
meillo@100: If it is conceptionally more elegant to have the MSA and MRA as
meillo@87: separate projects then they should be separated.
meillo@87: This is the case here, in my opinion.
meillo@87: The RFCs propose this separation by clearly distinguishing the different
meillo@87: mail handling tasks.
meillo@87: .[
meillo@87: rfc 821
meillo@87: .]
meillo@87: The small interfaces between the mail agents support the separation.
meillo@76: .P
meillo@87: In the beginning, email had been small and simple.
meillo@100: At that time,
meillo@60: .Pn /bin/mail
meillo@100: had covered anything there was to email and still had been small
meillo@100: and simple.
meillo@100: Later, the essential complexity of email increased.
meillo@87: (Essential complexity is the complexity defined by the problem itself.\0
meillo@87: .[[
meillo@87: brooks no silver bullet
meillo@87: .]])
meillo@87: Email systems reacted to this change: They grew.
meillo@100: RFCs started to introduce the concept of mail agents to separate the
meillo@100: various tasks because they became more extensive and new tasks appeared.
meillo@100: As the mail systems grew even more, parts were split off.
meillo@100: In nmh, for instance, the POP server, which was included in the original
meillo@100: MH, was removed.
meillo@100: Now is the time to go one step further and split the MSA and MRA off, too.
meillo@87: Not only does this decrease the code size of the project,
meillo@87: but, more important, it unburdens mmh of the whole field of
meillo@87: message transfer with all its implications for the project.
meillo@100: There is no more need to concern with changes in network transfer.
meillo@76: This independence is received by depending on an external program
meillo@76: that covers the field.
meillo@76: Today, this is a reasonable exchange.
meillo@60: .P
meillo@100: Functionality can be added in three different ways:
meillo@87: .BU
meillo@87: Implementing the function originally in the project.
meillo@87: .BU
meillo@87: Depending on a library that provides the function.
meillo@87: .BU
meillo@87: Depending on a program that provides the function.
meillo@87: .P
meillo@87: Whereas adding the function originally to the project increases the
meillo@76: code size most and requires most maintenance and development work,
meillo@87: it makes the project most independent of other software.
meillo@87: Using libraries or external programs require less maintenance work
meillo@87: but introduces dependencies on external software.
meillo@87: Programs have the smallest interfaces and provide the best separation
meillo@87: but possibly limit the information exchange.
meillo@87: External libraries are stronger connected than external programs,
meillo@87: thus information can be exchanged more flexible.
meillo@87: Adding code to a project increases maintenance work.
meillo@87: .\" XXX ref
meillo@100: Implementing complex functions originally in the project adds
meillo@87: a lot of code.
meillo@87: This should be avoided if possible.
meillo@66: Hence, the dependencies only change in kind, not in their existence.
meillo@66: In mmh, library dependencies on
meillo@66: .Pn libsasl2
meillo@66: and
meillo@66: .Pn libcrypto /\c
meillo@66: .Pn libssl
meillo@66: were treated against program dependencies on an MSA and an MRA.
meillo@87: This also meant treating build-time dependencies against run-time
meillo@87: dependencies.
meillo@66: Besides program dependencies providing the stronger separation
meillo@66: and being more flexible, they also allowed
meillo@66: over 6\|000 lines of code to be removed from mmh.
meillo@66: This made mmh's code base about 12\|% smaller.
meillo@87: Reducing the project's code size by such an amount without actually
meillo@87: losing functionality is a convincing argument.
meillo@87: Actually, as external MSAs and MRAs are likely superior to the
meillo@87: project's internal versions, the common user even gains functionality.
meillo@66: .P
meillo@76: Users of MH should not have problems to set up an external MSA and MRA.
meillo@60: Also, the popular MSAs and MRAs have large communities and a lot
meillo@60: of documentation available.
meillo@87: Choices for MSAs range from full-featured MTAs like
meillo@60: .I Postfix
meillo@87: over mid-size MTAs like
meillo@60: .I masqmail
meillo@60: and
meillo@60: .I dma
meillo@60: to small forwarders like
meillo@60: .I ssmtp
meillo@60: and
meillo@60: .I nullmailer .
meillo@60: Choices for MRAs include
meillo@60: .I fetchmail ,
meillo@60: .I getmail ,
meillo@60: .I mpop
meillo@60: and
meillo@60: .I fdm .
meillo@60: 
meillo@60: 
meillo@100: .H2 "Non-MUA Tools
meillo@60: .P
meillo@87: One goal of mmh is to remove the tools that are not part of the MUA's task.
meillo@89: Further more, any tools that don't improve the MUA's job significantly
meillo@87: should be removed.
meillo@87: Loosely related and rarely used tools distract from the lean appearance.
meillo@87: They require maintenance work without adding much to the core task.
meillo@100: By removing these tools, the project shall become more stream-lined
meillo@87: and focused.
meillo@76: In mmh the following tools are not available anymore:
meillo@62: .BU
meillo@58: .Pn conflict
meillo@87: was removed
meillo@76: .Ci 8b235097cbd11d728c07b966cf131aa7133ce5a9
meillo@87: because it is a mail system maintenance tool that is not MUA-related.
meillo@87: It even checked
meillo@58: .Fn /etc/passwd
meillo@58: and
meillo@58: .Fn /etc/group
meillo@87: for consistency, which is completely unrelated to email.
meillo@87: A tool like
meillo@87: .Pn conflict
meillo@87: is surely useful, but it should not be shipped with mmh.
meillo@76: .\" XXX historic reasons?
meillo@62: .BU
meillo@58: .Pn rcvtty
meillo@87: was removed
meillo@87: .Ci 14767c94b3827be7c867196467ed7aea5f6f49b0
meillo@89: because its use case of writing to the user's terminal
meillo@76: on receiving of mail is obsolete.
meillo@87: If users like to be informed of new mail, the shell's
meillo@58: .Ev MAILPATH
meillo@87: variable or graphical notifications are technically more appealing.
meillo@100: Writing directly to terminals is hardly ever wanted today.
meillo@62: If though one wants to have it this way, the standard tool
meillo@58: .Pn write
meillo@58: can be used in a way similar to:
meillo@82: .VS
meillo@58: scan -file - | write `id -un`
meillo@82: VE
meillo@62: .BU
meillo@58: .Pn viamail
meillo@87: was removed
meillo@87: .Ci eda72d6a7a7c20ff123043fb7f19c509ea01f932
meillo@87: when the new attachment system was activated, because
meillo@58: .Pn forw
meillo@76: could then cover the task itself.
meillo@62: The program
meillo@58: .Pn sendfiles
meillo@62: was rewritten as a shell script wrapper around
meillo@58: .Pn forw .
meillo@76: .Ci 0e82199cf3c991a173e0ac8aa776efdb3ded61e6
meillo@62: .BU
meillo@58: .Pn msgchk
meillo@87: was removed
meillo@87: .Ci bb9360ead7eb7a3fedcce2eeedfc660014e41dbe ,
meillo@87: because it lost its use case when POP support was removed.
meillo@76: A call to
meillo@58: .Pn msgchk
meillo@87: provided hardly more information than:
meillo@82: .VS
meillo@58: ls -l /var/mail/meillo
meillo@82: VE
meillo@100: It did distinguish between old and new mail, but
meillo@100: this detail information can be retrieved with
meillo@76: .Pn stat (1),
meillo@62: too.
meillo@100: A small shell script could be written to print the information
meillo@76: in a similar way, if truly necessary.
meillo@76: As mmh's
meillo@76: .Pn inc
meillo@87: only incorporates mail from the user's local maildrop,
meillo@62: and thus no data transfers over slow networks are involved,
meillo@76: there's hardly any need to check for new mail before incorporating it.
meillo@62: .BU
meillo@58: .Pn msh
meillo@87: was removed
meillo@76: .Ci 916690191222433a6923a4be54b0d8f6ac01bd02
meillo@87: because the tool was in conflict with the philosophy of MH.
meillo@76: It provided an interactive shell to access the features of MH,
meillo@76: but it wasn't just a shell, tailored to the needs of mail handling.
meillo@76: Instead it was one large program that had several MH tools built in.
meillo@76: This conflicts with the major feature of MH of being a tool chest.
meillo@76: .Pn msh 's
meillo@76: main use case had been accessing Bulletin Boards, which have seized to
meillo@62: be popular.
meillo@62: .P
meillo@62: Removing
meillo@58: .Pn msh ,
meillo@76: together with the truly archaic code relicts
meillo@58: .Pn vmh
meillo@58: and
meillo@58: .Pn wmh ,
meillo@62: saved more than 7\|000 lines of C code \(en
meillo@66: about 15\|% of the project's original source code amount.
meillo@100: Having less code \(en with equal readability, of course \(en
meillo@76: for the same functionality is an advantage.
meillo@63: Less code means less bugs and less maintenance work.
meillo@76: As
meillo@63: .Pn rcvtty
meillo@63: and
meillo@63: .Pn msgchk
meillo@87: are assumed to be rarely used and can be implemented in different ways,
meillo@87: why should one keep them?
meillo@76: Removing them stream-lines mmh.
meillo@63: .Pn viamail 's
meillo@63: use case is now partly obsolete and partly covered by
meillo@63: .Pn forw ,
meillo@76: hence there's no reason to still maintain it.
meillo@63: .Pn conflict
meillo@76: is not related to the mail client, and
meillo@63: .Pn msh
meillo@63: conflicts with the basic concept of MH.
meillo@76: Theses two tools might still be useful, but they should not be part of mmh.
meillo@63: .P
meillo@76: Finally, there's
meillo@76: .Pn slocal .
meillo@76: .Pn slocal
meillo@76: is an MDA and thus not directly MUA-related.
meillo@100: It should be removed from mmh, because including it conflicts with
meillo@100: the idea that mmh is a MUA only.
meillo@100: .Pn slocal
meillo@100: should rather become a separate project.
meillo@87: However,
meillo@76: .Pn slocal
meillo@76: provides rule-based processing of messages, like filing them into
meillo@76: different folders, which is otherwise not available in mmh.
meillo@87: Although
meillo@76: .Pn slocal
meillo@87: does neither pull in dependencies nor does it include a separate
meillo@100: technical area (cf. Sec. XXX), still,
meillo@100: it accounts for about 1\|000 lines of code that need to be maintained.
meillo@76: As
meillo@76: .Pn slocal
meillo@76: is almost self-standing, it should be split off into a separate project.
meillo@76: This would cut the strong connection between the MUA mmh and the MDA
meillo@76: .Pn slocal .
meillo@87: For anyone not using MH,
meillo@87: .Pn slocal
meillo@87: would become yet another independent MDA, like
meillo@87: .I procmail .
meillo@100: Then
meillo@87: .Pn slocal
meillo@100: could be installed without the complete MH system.
meillo@76: Likewise, mmh users could decide to use
meillo@76: .I procmail
meillo@87: without having a second, unused MDA,
meillo@87: .Pn slocal ,
meillo@76: installed.
meillo@100: That appears to be conceptionally the best solution.
meillo@76: Yet,
meillo@76: .Pn slocal
meillo@87: is not split off.
meillo@100: I defer the decision over
meillo@78: .Pn slocal
meillo@100: in need for deeper investigation.
meillo@100: In the meanwhile, it remains part of mmh.
meillo@100: That does not hurt because
meillo@100: .Pn slocal
meillo@100: is unrelated to the rest of the project.
meillo@0: 
meillo@58: 
meillo@76: .H2 "\fLshow\fP and \fPmhshow\fP
meillo@58: .P
meillo@69: Since the very beginning \(en already in the first concept paper \(en
meillo@58: .Pn show
meillo@62: had been MH's message display program.
meillo@58: .Pn show
meillo@76: mapped message numbers and sequences to files and invoked
meillo@58: .Pn mhl
meillo@89: to have the files formatted.
meillo@88: With MIME, this approach wasn't sufficient anymore.
meillo@100: MIME messages can consist of multiple parts. Some parts are not
meillo@100: directly displayable and text content might be encoded in
meillo@58: foreign charsets.
meillo@58: .Pn show 's
meillo@76: understanding of messages and
meillo@58: .Pn mhl 's
meillo@88: display capabilities couldn't cope with the task any longer.
meillo@62: .P
meillo@88: Instead of extending these tools, additional tools were written from
meillo@88: scratch and added to the MH tool chest.
meillo@88: Doing so is encouraged by the tool chest approach.
meillo@88: Modular design is a great advantage for extending a system,
meillo@88: as new tools can be added without interfering with existing ones.
meillo@62: First, the new MIME features were added in form of the single program
meillo@58: .Pn mhn .
meillo@58: The command
meillo@82: .Cl "mhn -show 42
meillo@58: would show the MIME message numbered 42.
meillo@58: With the 1.0 release of nmh in February 1999, Richard Coleman finished
meillo@58: the split of
meillo@58: .Pn mhn
meillo@88: into a set of specialized tools, which together covered the
meillo@88: multiple aspects of MIME.
meillo@88: One of them was
meillo@69: .Pn mhshow ,
meillo@88: which replaced
meillo@88: .Cl "mhn -show" .
meillo@88: It was capable of displaying MIME messages appropriately.
meillo@62: .P
meillo@88: From then on, two message display tools were part of nmh,
meillo@76: .Pn show
meillo@76: and
meillo@76: .Pn mhshow .
meillo@88: To ease the life of users,
meillo@69: .Pn show
meillo@69: was extended to automatically hand the job over to
meillo@69: .Pn mhshow
meillo@69: if displaying the message would be beyond
meillo@69: .Pn show 's
meillo@69: abilities.
meillo@88: In consequence, the user would simply invoke
meillo@69: .Pn show
meillo@69: (possibly through
meillo@69: .Pn next
meillo@69: or
meillo@69: .Pn prev )
meillo@69: and get the message printed with either
meillo@69: .Pn show
meillo@69: or
meillo@69: .Pn mhshow ,
meillo@69: whatever was more appropriate.
meillo@69: .P
meillo@69: Having two similar tools for essentially the same task is redundant.
meillo@88: Usually,
meillo@88: users wouldn't distinguish between
meillo@88: .Pn show
meillo@88: and
meillo@88: .Pn mhshow
meillo@88: in their daily mail reading.
meillo@88: Having two separate display programs was therefore mainly unnecessary
meillo@88: from a user's point of view.
meillo@88: Besides, the development of both programs needed to be in sync,
meillo@76: to ensure that the programs behaved in a similar way,
meillo@76: because they were used like a single tool.
meillo@76: Different behavior would have surprised the user.
meillo@69: .P
meillo@69: Today, non-MIME messages are rather seen to be a special case of
meillo@100: MIME messages, although it is the other way round.
meillo@69: As
meillo@69: .Pn mhshow
meillo@88: had already be able to display non-MIME messages, it appeared natural
meillo@69: to drop
meillo@69: .Pn show
meillo@69: in favor of using
meillo@69: .Pn mhshow
meillo@69: exclusively.
meillo@88: .Ci 4c1efddfd499300c7e74263e57d8aa137e84c853
meillo@88: Removing
meillo@88: .Pn show
meillo@88: is no loss in function, because functionally
meillo@88: .Pn mhshow
meillo@88: covers it completely.
meillo@88: The old behavior of
meillo@88: .Pn show
meillo@88: can still be emulated with the simple command line:
meillo@88: .VS
meillo@88: mhl `mhpath c`
meillo@88: VE
meillo@88: .P
meillo@76: For convenience,
meillo@76: .Pn mhshow
meillo@88: was renamed to
meillo@88: .Pn show
meillo@88: after
meillo@88: .Pn show
meillo@88: was gone.
meillo@88: It is clear that such a rename may confuse future developers when
meillo@88: trying to understand the history.
meillo@88: Nevertheless, I consider the convenience on the user's side,
meillo@88: to call
meillo@88: .Pn show
meillo@88: when they want a message to be displayed, to outweigh the inconvenience
meillo@88: on the developer's side when understanding the project history.
meillo@69: .P
meillo@88: To prepare for the transition,
meillo@69: .Pn mhshow
meillo@69: was reworked to behave more like
meillo@69: .Pn show
meillo@69: first.
meillo@88: (cf. Sec. XXX)
meillo@88: Once the tools behaved more alike, the replacing appeared to be
meillo@88: even more natural.
meillo@88: Today, mmh's new
meillo@69: .Pn show
meillo@88: became the one single message display program again, with the difference
meillo@88: that today it handles MIME messages as well as non-MIME messages.
meillo@88: The outcome of the transition is one program less to maintain,
meillo@88: no second display program for users to deal with,
meillo@88: and less system complexity.
meillo@69: .P
meillo@88: Still, removing the old
meillo@69: .Pn show
meillo@88: hurts in one regard: It had been such a simple program.
meillo@88: Its lean elegance is missing to the new
meillo@69: .Pn show .
meillo@88: But there is no chance;
meillo@88: supporting MIME demands for higher essential complexity.
meillo@58: 
meillo@58: 
meillo@100: .H2 "Configure Options
meillo@58: .P
meillo@76: Customization is a double-edged sword.
meillo@76: It allows better suiting setups, but not for free.
meillo@76: There is the cost of code complexity to be able to customize.
meillo@76: There is the cost of less tested setups, because there are
meillo@72: more possible setups and especially corner-cases.
meillo@76: And, there is the cost of choice itself.
meillo@76: The code complexity directly affects the developers.
meillo@72: Less tested code affects both, users and developers.
meillo@76: The problem of choice affects the users, for once by having to
meillo@100: choose, but also by more complex interfaces that require more documentation.
meillo@72: Whenever options add little advantages, they should be considered for
meillo@72: removal.
meillo@72: I have reduced the number of project-specific configure options from 
meillo@72: fifteen to three.
meillo@74: 
meillo@76: .U3 "Mail Transfer Facilities
meillo@74: .P
meillo@85: With the removal of the mail transfer facilities five configure
meillo@85: options vanished:
meillo@85: .P
meillo@85: The switches
meillo@85: .Sw --with-tls
meillo@85: and
meillo@85: .Sw --with-cyrus-sasl
meillo@89: had activated the support for transfer encryption and authentication.
meillo@85: This is not needed anymore.
meillo@85: .Ci fecd5d34f65597a4dfa16aeabea7d74b191532c3
meillo@85: .Ci 156d35f6425bea4c1ed3c4c79783dc613379c65b
meillo@85: .P
meillo@85: The configure switch
meillo@85: .Sw --enable-pop
meillo@85: activated the message retrieval facility.
meillo@85: The code area that would be conditionally compiled in for TLS and SASL
meillo@85: support had been small.
meillo@85: The conditionally compiled code area for POP support had been much larger.
meillo@85: Whereas the code base changes would only slightly change on toggling
meillo@85: TLS or SASL support, it changed much on toggling POP support.
meillo@85: The changes in the code base could hardly be overviewed.
meillo@85: By having POP support togglable a second code base had been created,
meillo@85: one that needed to be tested.
meillo@85: This situation is basically similar for the conditional TLS and SASL  
meillo@85: code, but there the changes are minor and can yet be overviewed.
meillo@85: Still, conditional compilation of a code base creates variations
meillo@85: of the original program.
meillo@85: More variations require more testing and maintenance work.
meillo@85: .P
meillo@85: Two other options only specified default configuration values:
meillo@100: .Sw --with-mts
meillo@100: defined the default transport service, either
meillo@100: .Ar smtp
meillo@100: or
meillo@100: .Ar sendmail .
meillo@85: In mmh this fixed to
meillo@85: .Ar sendmail .
meillo@85: .Ci f6aa95b724fd8c791164abe7ee5468bf5c34f226
meillo@85: With
meillo@100: .Sw --with-smtpservers
meillo@85: default SMTP servers for the
meillo@85: .Ar smtp
meillo@85: transport service could be specified.
meillo@72: .Ci 128545e06224233b7e91fc4c83f8830252fe16c9
meillo@85: Both of them became irrelevant.
meillo@72: 
meillo@74: .U3 "Backup Prefix
meillo@74: .P
meillo@76: The backup prefix is the string that was prepended to message
meillo@76: filenames to tag them as deleted.
meillo@76: By default it had been the comma character `\f(CW,\fP'.
meillo@78: In July 2000, Kimmo Suominen introduced
meillo@78: the configure option
meillo@78: .Sw --with-hash-backup
meillo@78: to change the default to the hash symbol `\f(CW#\fP'.
meillo@78: The choice was probably personal preference, because first, the
meillo@78: option was named
meillo@78: .Sw --with-backup-prefix.
meillo@78: and had the prefix symbol as argument.
meillo@100: But giving the hash symbol as argument caused too many problems
meillo@100: for Autoconf,
meillo@100: thus the option was limited to use the hash symbol as the default prefix.
meillo@100: This supports the assumption, that the choice for the hash was
meillo@100: personal preference only.
meillo@100: Being related or not, words that start with the hash symbol
meillo@78: introduce a comment in the Unix shell.
meillo@72: Thus, the command line
meillo@72: .Cl "rm #13 #15
meillo@72: calls
meillo@72: .Pn rm
meillo@72: without arguments because the first hash symbol starts the comment
meillo@72: that reaches until the end of the line.
meillo@72: To delete the backup files,
meillo@72: .Cl "rm ./#13 ./#15"
meillo@72: needs to be used.
meillo@100: Using the hash as backup prefix can be seen as a precaution against
meillo@78: data loss.
meillo@78: .P
meillo@72: I removed the configure option but added the profile entry
meillo@72: .Pe backup-prefix ,
meillo@72: which allows to specify an arbitrary string as backup prefix.
meillo@72: .Ci 6c40d481d661d532dd527eaf34cebb6d3f8ed086
meillo@76: Profile entries are the common method to change mmh's behavior.
meillo@76: This change did not remove the choice but moved it to a location where
meillo@72: it suited better.
meillo@76: .P
meillo@78: Eventually, however, the new trash folder concept
meillo@78: .Cf "Sec. XXX
meillo@78: obsoleted the concept of the backup prefix completely.
meillo@78: .Ci 8edc5aaf86f9f77124664f6801bc6c6cdf258173
meillo@100: .\" (Well, there still are corner-cases to remove until the backup
meillo@100: .\" prefix can be laid to rest, eventually.)
meillo@72: .\" FIXME: Do this work in the code!
meillo@76: 
meillo@76: .U3 "Editor and Pager
meillo@74: .P
meillo@74: The two configure options
meillo@74: .CW --with-editor=EDITOR
meillo@74: .CW --with-pager=PAGER
meillo@74: were used to specify the default editor and pager at configure time.
meillo@109: Doing so at configure time made sense in the eighties,
meillo@76: when the set of available editors and pagers varied much across
meillo@76: different systems.
meillo@89: Today, the situation is more homogeneous.
meillo@74: The programs
meillo@74: .Pn vi
meillo@74: and
meillo@74: .Pn more
meillo@76: can be expected to be available on every Unix system,
meillo@74: as they are specified by POSIX since two decades.
meillo@74: (The specifications for
meillo@74: .Pn vi
meillo@74: and
meillo@74: .Pn more
meillo@74: appeared in
meillo@74: .[
meillo@74: posix 1987
meillo@74: .]
meillo@74: and,
meillo@74: .[
meillo@74: posix 1992
meillo@74: .]
meillo@74: respectively.)
meillo@74: As a first step, these two tools were hard-coded as defaults.
meillo@74: .Ci 5d43a99db70c12a673028c7758c20cbe3e13ef5f
meillo@74: Not changed were the
meillo@74: .Pe editor
meillo@74: and
meillo@74: .Pe moreproc
meillo@76: profile entries, which allowed the user to override the system defaults.
meillo@74: Later, the concept was reworked to respect the standard environment
meillo@74: variables
meillo@74: .Ev VISUAL
meillo@74: and
meillo@74: .Ev PAGER
meillo@76: if they are set.
meillo@74: Today, mmh determines the editor to use in the following order,
meillo@74: taking the first available and non-empty item:
meillo@74: .IP (1)
meillo@74: Environment variable
meillo@74: .Ev MMHEDITOR
meillo@74: .IP (2)
meillo@74: Profile entry
meillo@74: .Pe Editor
meillo@74: .IP (3)
meillo@74: Environment variable
meillo@74: .Ev VISUAL
meillo@74: .IP (4)
meillo@74: Environment variable
meillo@74: .Ev EDITOR
meillo@74: .IP (5)
meillo@74: Command
meillo@74: .Pn vi .
meillo@74: .P
meillo@76: .Ci f85f4b7ae62e3d05a945dcd46ead51f0a2a89a9b
meillo@76: .P
meillo@89: The pager to use is determined in a similar order,
meillo@74: also taking the first available and non-empty item:
meillo@74: .IP (1)
meillo@74: Environment variable
meillo@74: .Ev MMHPAGER
meillo@74: .IP (2)
meillo@74: Profile entry
meillo@74: .Pe Pager
meillo@74: (replaces
meillo@74: .Pe moreproc )
meillo@74: .IP (3)
meillo@74: Environment variable
meillo@74: .Ev PAGER
meillo@74: .IP (4)
meillo@74: Command
meillo@74: .Pn more .
meillo@74: .P
meillo@74: .Ci 0c4214ea2aec6497d0d67b436bbee9bc1d225f1e
meillo@74: .P
meillo@76: By respecting the
meillo@74: .Ev VISUAL /\c
meillo@74: .Ev EDITOR
meillo@74: and
meillo@74: .Ev PAGER
meillo@76: environment variables,
meillo@76: the new behavior confirms better to the common style on Unix systems.
meillo@76: Additionally, the new approach is more uniform and clearer to users.
meillo@72: 
meillo@72: 
meillo@76: .U3 "ndbm
meillo@72: .P
meillo@74: .Pn slocal
meillo@78: used to depend on
meillo@74: .I ndbm ,
meillo@74: a database library.
meillo@76: The database is used to store the `\fLMessage-ID\fP's of all
meillo@76: messages delivered.
meillo@74: This enables
meillo@74: .Pn slocal
meillo@74: to suppress delivering the same message to the same user twice.
meillo@74: (This features was enabled by the
meillo@74: .Sw -suppressdup
meillo@74: switch.)
meillo@74: .P
meillo@100: A variety of versions of the database library exist.
meillo@78: .[
meillo@78: wolter unix incompat notes dbm
meillo@78: .]
meillo@74: Complicated autoconf code was needed to detect them correctly.
meillo@74: Further more, the configure switches
meillo@74: .Sw --with-ndbm=ARG
meillo@74: and
meillo@74: .Sw --with-ndbmheader=ARG
meillo@74: were added to help with difficult setups that would
meillo@78: not be detected automatically or correctly.
meillo@74: .P
meillo@74: By removing the suppress duplicates feature of
meillo@74: .Pn slocal ,
meillo@74: the dependency on
meillo@74: .I ndbm
meillo@78: vanished and 120 lines of complex autoconf code could be saved.
meillo@74: .Ci ecd6d6a20cb7a1507e3a20d6c4cb3a1cf14c6bbf
meillo@89: The change removed functionality too, but that is minor to the
meillo@78: improvement by dropping the dependency and the complex autoconf code.
meillo@72: 
meillo@74: .U3 "mh-e Support
meillo@72: .P
meillo@74: The configure option
meillo@74: .Sw --disable-mhe
meillo@74: was removed when the mh-e support was reworked. 
meillo@74: Mh-e is the Emacs front-end to MH.
meillo@76: It requires MH to provide minor additional functions.
meillo@76: The
meillo@76: .Sw --disable-mhe
meillo@76: configure option could switch these extensions off.
meillo@76: After removing the support for old versions of mh-e,
meillo@74: only the
meillo@74: .Sw -build
meillo@76: switches of
meillo@74: .Pn forw
meillo@74: and
meillo@74: .Pn repl
meillo@76: are left to be mh-e extensions.
meillo@76: They are now always built in because they add little code and complexity.
meillo@76: In consequence, the
meillo@74: .Sw --disable-mhe
meillo@76: configure option was removed
meillo@72: .Ci a7ce7b4a580d77b6c2c4d980812beb589aa4c643
meillo@74: Removing the option removed a second code setup that would have
meillo@74: needed to be tested.
meillo@76: This change was first done in nmh and thereafter merged into mmh.
meillo@76: .P
meillo@76: The interface changes in mmh require mh-e to be adjusted in order
meillo@76: to be able to use mmh as back-end.
meillo@76: This will require minor changes to mh-e, but removing the
meillo@76: .Sw -build
meillo@76: switches would require more rework.
meillo@72: 
meillo@74: .U3 "Masquerading
meillo@72: .P
meillo@74: The configure option
meillo@74: .Sw --enable-masquerade
meillo@76: could take up to three arguments:
meillo@76: `draft_from', `mmailid', and `username_extension'.
meillo@74: They activated different types of address masquerading.
meillo@74: All of them were implemented in the SMTP-speaking
meillo@74: .Pn post
meillo@76: command, which provided an MSA.
meillo@76: Address masquerading is an MTA's task and mmh does not cover
meillo@76: this field anymore.
meillo@76: Hence, true masquerading needs to be implemented in the external MTA.
meillo@74: .P
meillo@74: The
meillo@74: .I mmailid
meillo@74: masquerading type is the oldest one of the three and the only one
meillo@74: available in the original MH.
meillo@74: It provided a
meillo@74: .I username
meillo@74: to
meillo@74: .I fakeusername
meillo@76: mapping, based on the password file's GECOS field.
meillo@74: The man page
meillo@74: .Mp mh-tailor(5)
meillo@74: described the use case as being the following:
meillo@98: .QS
meillo@74: This is useful if you want the messages you send to always
meillo@74: appear to come from the name of an MTA alias rather than your
meillo@74: actual account name.  For instance, many organizations set up
meillo@74: `First.Last' sendmail aliases for all users.  If this is
meillo@74: the case, the GECOS field for each user should look like:
meillo@74: ``First [Middle] Last <First.Last>''
meillo@98: .QE
meillo@74: .P
meillo@74: As mmh sends outgoing mail via the local MTA only,
meillo@76: the best location to do such global rewrites is there.
meillo@74: Besides, the MTA is conceptionally the right location because it
meillo@74: does the reverse mapping for incoming mail (aliasing), too.
meillo@76: Further more, masquerading set up there is readily available for all
meillo@74: mail software on the system.
meillo@76: Hence, mmailid masquerading was removed.
meillo@74: .Ci 0836c8000ccb34b59410ef1c15b1b7feac70ce5f
meillo@74: .P
meillo@74: The
meillo@74: .I username_extension
meillo@76: masquerading type did not replace the username but would append a suffix,
meillo@76: specified by the
meillo@74: .Ev USERNAME_EXTENSION
meillo@76: environment variable, to it.
meillo@76: This provided support for the
meillo@74: .I user-extension
meillo@74: feature of qmail and the similar
meillo@74: .I "plussed user
meillo@74: processing of sendmail.
meillo@74: The decision to remove this username_extension masquerading was
meillo@74: motivated by the fact that
meillo@74: .Pn spost
meillo@76: hadn't supported it already.
meillo@76: .Ci 2abae0bfd0ad5bf898461e50aa4b466d641f23d9
meillo@76: Username extensions are possible in mmh, but less convenient to use.
meillo@76: .\" XXX format file %(getenv USERNAME_EXTENSION)
meillo@74: .P
meillo@74: The
meillo@74: .I draft_from
meillo@74: masquerading type instructed
meillo@74: .Pn post
meillo@84: to use the value of the
meillo@84: .Hd From
meillo@84: header field as SMTP envelope sender.
meillo@76: Sender addresses could be replaced completely.
meillo@74: .Ci b14ea6073f77b4359aaf3fddd0e105989db9
meillo@76: Mmh offers a kind of masquerading similar in effect, but
meillo@74: with technical differences.
meillo@76: As mmh does not transfer messages itself, the local MTA has final control
meillo@76: over the sender's address. Any masquerading mmh introduces may be reverted
meillo@76: by the MTA.
meillo@76: In times of pedantic spam checking, an MTA will take care to use
meillo@76: sensible envelope sender addresses to keep its own reputation up.
meillo@84: Nonetheless, the MUA can set the
meillo@84: .Hd From
meillo@84: header field and thereby propose
meillo@76: a sender address to the MTA.
meillo@74: The MTA may then decide to take that one or generate the canonical sender
meillo@74: address for use as envelope sender address.
meillo@74: .P
meillo@74: In mmh, the MTA will always extract the recipient and sender from the
meillo@84: message header (\c
meillo@74: .Pn sendmail 's
meillo@74: .Sw -t
meillo@74: switch).
meillo@84: The
meillo@84: .Hd From
meillo@84: header field of the draft may be set arbitrary by the user.
meillo@74: If it is missing, the canonical sender address will be generated by the MTA.
meillo@74: 
meillo@74: .U3 "Remaining Options
meillo@74: .P
meillo@74: Two configure options remain in mmh.
meillo@74: One is the locking method to use:
meillo@74: .Sw --with-locking=[dot|fcntl|flock|lockf] .
meillo@76: The idea of removing all methods except the portable dot locking
meillo@76: and having that one as the default is appealing, but this change
meillo@76: requires deeper technical investigation into the topic.
meillo@76: The other option,
meillo@74: .Sw --enable-debug ,
meillo@74: compiles the programs with debugging symbols and does not strip them.
meillo@74: This option is likely to stay.
meillo@72: 
meillo@72: 
meillo@58: 
meillo@63: 
meillo@100: .H2 "Command Line Switches
meillo@58: .P
meillo@93: The command line switches of MH tools follow the X Window style.
meillo@93: They are words, introduced by a single dash.
meillo@93: For example:
meillo@93: .Cl "-truncate" .
meillo@93: Every program in mmh has two generic switches:
meillo@93: .Sw -help ,
meillo@93: to print a short message on how to use the program, and 
meillo@93: .Sw -Version ,
meillo@93: to tell what version of mmh the program belongs to.
meillo@93: .P
meillo@93: Switches change the behavior of programs.
meillo@93: Programs that do one thing in one way require no switches.
meillo@93: In most cases, doing something in exactly one way is too limiting.
meillo@97: If there is basically one task to accomplish, but it should be done
meillo@93: in various ways, switches are a good approach to alter the behavior
meillo@93: of a program.
meillo@93: Changing the behavior of programs provides flexibility and customization
meillo@97: to users, but at the same time it complicates the code, documentation and
meillo@93: usage of the program.
meillo@97: .\" XXX: Ref
meillo@93: Therefore, the number of switches should be kept small.
meillo@93: A small set of well-chosen switches does no harm.
meillo@93: But usually, the number of switches increases over time.
meillo@93: Already in 1985, Rose and Romine have identified this as a major
meillo@93: problem of MH:
meillo@93: .[ [
meillo@93: rose romine real work
meillo@93: .], p. 12]
meillo@98: .QS
meillo@93: A complaint often heard about systems which undergo substantial development
meillo@93: by many people over a number of years, is that more and more options are
meillo@93: introduced which add little to the functionality but greatly increase the
meillo@93: amount of information a user needs to know in order to get useful work done.
meillo@93: This is usually referred to as creeping featurism.
meillo@93: .QP
meillo@93: Unfortunately MH, having undergone six years of off-and-on development by
meillo@93: ten or so well-meaning programmers (the present authors included),
meillo@93: suffers mightily from this.
meillo@98: .QE
meillo@93: .P
meillo@97: Being reluctant to adding new switches \(en or `options',
meillo@97: as Rose and Romine call them \(en is one part of a counter-action,
meillo@97: the other part is removing hardly used switches.
meillo@97: Nmh's tools had lots of switches already implemented,
meillo@97: hence, cleaning up by removing some of them was the more important part
meillo@97: of the counter-action.
meillo@93: Removing existing functionality is always difficult because it
meillo@93: breaks programs that use these functions.
meillo@93: Also, for every obsolete feature, there'll always be someone who still
meillo@93: uses it and thus opposes its removal.
meillo@93: This puts the developer into the position,
meillo@93: where sensible improvements to style are regarded as destructive acts.
meillo@97: Yet, living with the featurism is far worse, in my eyes, because
meillo@97: future needs will demand adding further features,
meillo@93: worsening the situation more and more.
meillo@93: Rose and Romine added in a footnote,
meillo@93: ``[...]
meillo@93: .Pn send
meillo@93: will no doubt acquire an endless number of switches in the years to come.''
meillo@97: Although clearly humorous, the comment points to the nature of the problem.
meillo@97: Refusing to add any new switches would encounter the problem at its root,
meillo@97: but this is not practical.
meillo@97: New needs will require new switches and it would be unwise to block
meillo@97: them strictly.
meillo@97: Nevertheless, removing obsolete switches still is an effective approach
meillo@97: to deal with the problem.
meillo@97: Working on an experimental branch without an established user base,
meillo@97: eased my work because I did not offend users when I removed existing
meillo@110: functions.
meillo@93: .P
meillo@93: Rose and Romine counted 24 visible and 9 more hidden switches for
meillo@93: .Pn send .
meillo@97: In nmh, they increased up to 32 visible and 12 hidden ones.
meillo@97: At the time of writing, no more than 7 visible switches and 1 hidden switch
meillo@97: have remained in mmh's
meillo@97: .Pn send .
meillo@97: (These numbers include two generic switches, help and version.)
meillo@93: .P
meillo@97: Fig. XXX
meillo@93: .\" XXX Ref
meillo@97: displays the number of switches for each of the tools that is available
meillo@97: in both, nmh and mmh.
meillo@100: The tools are sorted by the number of switches they had in nmh.
meillo@100: Visible and hidden switches were counted,
meillo@97: but not the generic help and version switches.
meillo@93: Whereas in the beginning of the project, the average tool had 11 switches,
meillo@93: now it has no more than 5 \(en only half as many.
meillo@93: If the `no' switches and similar inverse variant are folded onto
meillo@100: their counter-parts, the average tool had 8 switches in pre-mmh times and
meillo@100: has 4 now.
meillo@93: The total number of functional switches in mmh dropped from 465
meillo@93: to 234.
meillo@58: 
meillo@93: .KS
meillo@93: .in 1c
meillo@93: .so input/switches.grap
meillo@93: .KE
meillo@58: 
meillo@93: .P
meillo@93: A part of the switches vanished after functions were removed.
meillo@93: This was the case for network mail transfer, for instance.
meillo@97: Sometimes, however, the work flow was the other way:
meillo@97: I looked through the
meillo@97: .Mp mh-chart (7)
meillo@97: man page to identify the tools with apparently too many switches.
meillo@97: Then considering the value of each of the switches by examining
meillo@97: the tool's man page and source code, aided by recherche and testing.
meillo@97: This way, the removal of functions was suggested by the aim to reduce
meillo@97: the number of switches per command.
meillo@97: 
meillo@58: 
meillo@93: .U3 "Draft Folder Facility
meillo@93: .P
meillo@100: A change early in the project was the complete transition from
meillo@93: the single draft message to the draft folder facility.
meillo@97: .Ci 337338b404931f06f0db2119c9e145e8ca5a9860
meillo@109: The draft folder facility was introduced in the mid-eighties, when
meillo@100: Rose and Romine called it a ``relatively new feature''.
meillo@93: .[
meillo@93: rose romine real work
meillo@93: .]
meillo@110: Since then, the facility had existed but was inactive by default.
meillo@93: The default activation and the related rework of the tools made it
meillo@93: possible to remove the
meillo@93: .Sw -[no]draftfolder ,
meillo@93: and
meillo@93: .Sw -draftmessage
meillo@93: switches from
meillo@93: .Pn comp ,
meillo@93: .Pn repl ,
meillo@93: .Pn forw ,
meillo@93: .Pn dist ,
meillo@93: .Pn whatnow ,
meillo@93: and
meillo@93: .Pn send .
meillo@97: .Ci 337338b404931f06f0db2119c9e145e8ca5a9860
meillo@97: The only flexibility removed with this change is having multiple
meillo@97: draft folders within one profile.
meillo@97: I consider this a theoretical problem only.
meillo@93: In the same go, the
meillo@93: .Sw -draft
meillo@93: switch of
meillo@93: .Pn anno ,
meillo@93: .Pn refile ,
meillo@93: and
meillo@93: .Pn send
meillo@93: was removed.
meillo@93: The special-casing of `the' draft message became irrelevant after
meillo@93: the rework of the draft system.
meillo@93: (See Sec. XXX.)
meillo@95: Equally,
meillo@95: .Pn comp
meillo@95: lost its
meillo@95: .Sw -file
meillo@95: switch.
meillo@95: The draft folder facility, together with the
meillo@95: .Sw -form
meillo@95: switch, are sufficient.
meillo@93: 
meillo@95: 
meillo@102: .U3 "In Place Editing
meillo@93: .P
meillo@93: .Pn anno
meillo@93: had the switches
meillo@93: .Sw -[no]inplace
meillo@100: to either annotate the message in place and thus preserve hard links,
meillo@93: or annotate a copy to replace the original message, breaking hard links.
meillo@97: Following the assumption that linked messages should truly be the
meillo@97: same message, and annotating it should not break the link, the
meillo@93: .Sw -[no]inplace
meillo@93: switches were removed and the previous default
meillo@93: .Sw -inplace
meillo@93: was made the only behavior.
meillo@97: .Ci c8195849d2e366c569271abb0f5f60f4ebf0b4d0
meillo@93: The
meillo@93: .Sw -[no]inplace
meillo@93: switches of
meillo@93: .Pn repl ,
meillo@93: .Pn forw ,
meillo@93: and
meillo@93: .Pn dist
meillo@93: could be removed, too, as they were simply passed through to
meillo@93: .Pn anno .
meillo@93: .P
meillo@93: .Pn burst
meillo@93: also had
meillo@93: .Sw -[no]inplace
meillo@95: switches, but with different meaning.
meillo@95: With
meillo@95: .Sw -inplace ,
meillo@95: the digest had been replaced by the table of contents (i.e. the
meillo@110: introduction text) and the burst messages were placed right
meillo@95: after this message, renumbering all following messages.
meillo@95: Also, any trailing text of the digest was lost, though,
meillo@95: in practice, it usually consists of an end-of-digest marker only.
meillo@95: Nontheless, this behavior appeared less elegant than the
meillo@95: .Sw -noinplace
meillo@95: behavior, which already had been the default.
meillo@95: Nmh's
meillo@95: .Mp burst (1)
meillo@95: man page reads:
meillo@95: .sp \n(PDu
meillo@98: .QS
meillo@93: If -noinplace is given, each digest is preserved, no table
meillo@93: of contents is produced, and the messages contained within
meillo@93: the digest are placed at the end of the folder. Other messages
meillo@93: are not tampered with in any way.
meillo@98: .QE
meillo@95: .LP
meillo@93: The decision to drop the
meillo@93: .Sw -inplace
meillo@95: behavior was supported by the code complexity and the possible data loss
meillo@95: it caused.
meillo@93: .Sw -noinplace
meillo@95: was chosen to be the definitive behavior.
meillo@97: .Ci 68a686adeb39223a5e1ad35e4a24890ec053679d
meillo@93: 
meillo@95: 
meillo@95: .U3 "Forms and Format Strings
meillo@93: .P
meillo@95: Historically, the tools that had
meillo@95: .Sw -form
meillo@95: switches to supply a form file had
meillo@95: .Sw -format
meillo@95: switches as well to supply the contents of a form file as a string
meillo@95: on the command line directly.
meillo@95: In consequence, the following two lines equaled:
meillo@95: .VS
meillo@95: scan -form scan.mailx
meillo@95: scan -format "`cat .../scan.mailx`"
meillo@95: VE
meillo@95: The
meillo@95: .Sw -format
meillo@95: switches were dropped in favor for extending the
meillo@95: .Sw -form
meillo@95: switches.
meillo@97: .Ci f51956be123db66b00138f80464d06f030dbb88d
meillo@95: If their argument starts with an equal sign (`='),
meillo@95: then the rest of the argument is taken as a format string,
meillo@95: otherwise the arguments is treated as the name of a format file.
meillo@95: Thus, now the following two lines equal:
meillo@95: .VS
meillo@95: scan -form scan.mailx
meillo@95: scan -form "=`cat .../scan.mailx`"
meillo@95: VE
meillo@95: This rework removed the prefix collision between
meillo@95: .Sw -form
meillo@95: and
meillo@95: .Sw -format .
meillo@95: Now, typing
meillo@95: .Sw -fo
meillo@95: suffices to specify form or format string.
meillo@95: .P
meillo@95: The different meaning of
meillo@95: .Sw -format
meillo@95: for
meillo@95: .Pn repl
meillo@95: and
meillo@95: .Pn forw
meillo@95: was removed in mmh.
meillo@95: .Pn forw
meillo@95: was completely switched to MIME-type forwarding, thus removing the
meillo@95: .Sw -[no]format .
meillo@97: .Ci 6e271608b7b9c23771523f88d23a4d3593010cf1
meillo@95: For
meillo@95: .Pn repl ,
meillo@95: the
meillo@95: .Sw -[no]format
meillo@95: switches were reworked to
meillo@95: .Sw -[no]filter
meillo@95: switches.
meillo@97: .Ci 67411b1f95d6ec987b4c732459e1ba8a8ac192c6
meillo@95: The
meillo@95: .Sw -format
meillo@95: switches of
meillo@95: .Pn send
meillo@95: and
meillo@95: .Pn post ,
meillo@95: which had a third meaning,
meillo@95: were removed likewise.
meillo@97: .Ci f3cb7cde0e6f10451b6848678d95860d512224b9
meillo@95: Eventually, the ambiguity of the
meillo@95: .Sw -format
meillo@95: switches was resolved by not anymore having any such switch in mmh.
meillo@95: 
meillo@95: 
meillo@95: .U3 "MIME Tools
meillo@95: .P
meillo@95: The MIME tools, which were once part of
meillo@100: .Pn mhn
meillo@100: [sic!],
meillo@95: had several switches that added little practical value to the programs.
meillo@95: The
meillo@95: .Sw -[no]realsize
meillo@95: switches of
meillo@95: .Pn mhbuild
meillo@95: and
meillo@95: .Pn mhlist
meillo@97: were removed, doing real size calculations always now
meillo@97: .Ci 8d8f1c3abc586c005c904e52c4adbfe694d2201c ,
meillo@97: as
meillo@95: ``This provides an accurate count at the expense of a small delay.''
meillo@95: This small delay is not noticable on modern systems.
meillo@95: .P
meillo@95: The
meillo@95: .Sw -[no]check
meillo@95: switches were removed together with the support for
meillo@95: .Hd Content-MD5
meillo@95: header fields.
meillo@95: .[
meillo@95: rfc 1864
meillo@95: .]
meillo@97: .Ci 31dc797eb5178970d68962ca8939da3fd9a8efda
meillo@95: (See Sec. XXX)
meillo@95: .P
meillo@95: The
meillo@95: .Sw -[no]ebcdicsafe
meillo@95: and
meillo@95: .Sw -[no]rfc934mode
meillo@95: switches of
meillo@95: .Pn mhbuild
meillo@95: were removed because they are considered obsolete.
meillo@97: .Ci 01a3480928da485b4d6109d36d751dfa71799d58
meillo@97: .Ci 3363e2624dce0eb8164cf8b3f1ab385c8ff72e88
meillo@95: .P
meillo@95: Content caching of external MIME parts, activated with the
meillo@95: .Sw -rcache
meillo@95: and
meillo@95: .Sw -wcache
meillo@95: switches was completely removed.
meillo@97: .Ci d1fefd9f614e4dc3cda16da6c69133c1b2005269
meillo@97: External MIME parts are rare today, having a caching facility
meillo@96: for them is appears to be unnecessary.
meillo@95: .P
meillo@95: In pre-MIME times,
meillo@95: .Pn mhl
meillo@95: had covered many tasks that are part of MIME handling today.
meillo@95: Therefore,
meillo@95: .Pn mhl
meillo@95: could be simplified to a large extend, reducing the number of its
meillo@95: switches from 21 to 6.
meillo@97: .Ci 350ad6d3542a07639213cf2a4fe524e829c1e7b6
meillo@97: .Ci 0e46503be3c855bddaeae3843e1b659279c35d70
meillo@95: 
meillo@95: 
meillo@95: .U3 "Mail Transfer Switches
meillo@95: .P
meillo@95: With the removal of the mail transfer facilities, a lot of switches
meillo@95: vanished automatically.
meillo@95: .Pn inc
meillo@95: lost 9 switches, namely
meillo@95: .Sw -host ,
meillo@95: .Sw -port ,
meillo@95: .Sw -user ,
meillo@95: .Sw -proxy ,
meillo@95: .Sw -snoop ,
meillo@95: .Sw -[no]pack ,
meillo@95: as well as
meillo@95: .Sw -sasl
meillo@95: and
meillo@95: .Sw -saslmech .
meillo@95: .Pn send
meillo@95: and
meillo@95: .Pn post 
meillo@95: lost 11 switches each, namely
meillo@95: .Sw -server ,
meillo@95: .Sw -port ,
meillo@95: .Sw -client ,
meillo@95: .Sw -user ,
meillo@95: .Sw -mail ,
meillo@95: .Sw -saml ,
meillo@95: .Sw -send ,
meillo@95: .Sw -soml ,
meillo@95: .Sw -snoop ,
meillo@95: as well as
meillo@95: .Sw -sasl ,
meillo@95: .Sw -saslmech ,
meillo@95: and
meillo@95: .Sw -tls .
meillo@95: .Pn send
meillo@95: had the switches only to pass them further to
meillo@95: .Pn post ,
meillo@95: because the user would invoke
meillo@95: .Pn post
meillo@95: not directly, but through
meillo@95: .Pn send .
meillo@95: All these switches, except
meillo@95: .Sw -snoop
meillo@95: were usually defined as default switches in the user's profile,
meillo@95: but hardly given in interactive usage.
meillo@95: .P
meillo@95: Of course, those switches did not really ``vanish'', but the configuration
meillo@95: they did was handed over to external MSAs and MRAs.
meillo@95: Instead of setting up the mail transfer in mmh, it is set up in
meillo@95: external tools.
meillo@95: Yet, this simplifies mmh.
meillo@95: Specialized external tools will likely have simple configuration files.
meillo@95: Hence, instead of having one complicated central configuration file,
meillo@95: the configuration of each domain is separate.
meillo@95: Although the user needs to learn to configure each of the tools,
meillo@95: each configuration is likely much simpler.
meillo@95: 
meillo@95: 
meillo@95: .U3 "Maildrop Formats
meillo@95: .P
meillo@95: With the removal of MMDF maildrop format support,
meillo@95: .Pn packf
meillo@95: and
meillo@95: .Pn rcvpack
meillo@95: no longer needed their
meillo@95: .Sw -mbox
meillo@95: and
meillo@95: .Sw -mmdf
meillo@95: switches.
meillo@95: .Sw -mbox
meillo@95: is the sole  behavior now.
meillo@97: .Ci 3916ab66ad5d183705ac12357621ea8661afd3c0
meillo@95: In the same go,
meillo@95: .Pn packf
meillo@97: and
meillo@97: .Pn rcvpack
meillo@97: were reworked (see Sec. XXX) and their
meillo@95: .Sw -file
meillo@95: switch became unnecessary.
meillo@97: .Ci ca1023716d4c2ab890696f3e41fa0d94267a940e
meillo@95: 
meillo@95: 
meillo@95: .U3 "Terminal Magic
meillo@95: .P
meillo@95: Mmh's tools will no longer clear the screen (\c
meillo@95: .Pn scan 's
meillo@95: and
meillo@95: .Pn mhl 's
meillo@95: .Sw -[no]clear
meillo@97: switches
meillo@97: .Ci e57b17343dcb3ff373ef4dd089fbe778f0c7c270
meillo@97: .Ci 943765e7ac5693ae177fd8d2b5a2440e53ce816e ).
meillo@95: Neither will
meillo@95: .Pn mhl
meillo@95: ring the bell (\c
meillo@97: .Sw -[no]bell
meillo@97: .Ci e11983f44e59d8de236affa5b0d0d3067c192e24 )
meillo@95: nor page the output itself (\c
meillo@97: .Sw -length
meillo@97: .Ci 5b9d883db0318ed2b84bb82dee880d7381f99188 ).
meillo@95: .P
meillo@95: Generally, the pager to use is no longer specified with the
meillo@95: .Sw -[no]moreproc
meillo@95: command line switches for
meillo@95: .Pn mhl
meillo@95: and
meillo@95: .Pn show /\c
meillo@95: .Pn mhshow .
meillo@97: .Ci 39e87a75b5c2d3572ec72e717720b44af291e88a
meillo@95: .P
meillo@95: .Pn prompter
meillo@95: lost its
meillo@95: .Sw -erase
meillo@95: and
meillo@95: .Sw -kill
meillo@95: switches because today the terminal cares for the line editing keys.
meillo@95: 
meillo@95: 
meillo@95: .U3 "Header Printing
meillo@95: .P
meillo@95: .Pn folder 's
meillo@95: data output is self-explaining enough that
meillo@95: displaying the header line makes few sense.
meillo@95: Hence, the
meillo@95: .Sw -[no]header
meillo@95: switch was removed and headers are never printed.
meillo@97: .Ci 601cc73d1fa05ce96faa728f036d6c51b91701c7
meillo@95: .P
meillo@95: In
meillo@95: .Pn mhlist ,
meillo@95: the
meillo@95: .Sw -[no]header
meillo@95: switches were removed, too.
meillo@97: .Ci b24f96523aaf60e44e04a3ffb1d22e69a13a602f
meillo@95: But in this case headers are always printed,
meillo@95: because the output is not self-explaining.
meillo@95: .P
meillo@95: .Pn scan
meillo@95: also had
meillo@95: .Sw -[no]header
meillo@95: switches.
meillo@95: Printing the header had been sensible until the introduction of
meillo@95: format strings made it impossible to display the column headings.
meillo@95: Only the folder name and the current date remained to be printed.
meillo@95: As this information can be perfectly retrieved by
meillo@95: .Pn folder
meillo@95: and
meillo@95: .Pn date ,
meillo@95: consequently, the switches were removed.
meillo@97: .Ci c477dc5d1d03fa6d9a8ab3dd3508c63cbddc044e
meillo@95: .P
meillo@95: By removing all
meillo@95: .Sw -header
meillo@95: switches, the collision with
meillo@95: .Sw -help
meillo@95: on the first two letters was resolved.
meillo@95: Currently,
meillo@95: .Sw -h
meillo@95: evaluates to
meillo@95: .Sw -help
meillo@95: for all tools of mmh.
meillo@95: 
meillo@95: 
meillo@95: .U3 "Suppressing Edits or the WhatNow Shell
meillo@95: .P
meillo@95: The
meillo@95: .Sw -noedit
meillo@100: switch of
meillo@95: .Pn comp ,
meillo@95: .Pn repl ,
meillo@95: .Pn forw ,
meillo@95: .Pn dist ,
meillo@95: and
meillo@95: .Pn whatnow
meillo@95: was removed, but it can now be replaced by specifying
meillo@95: .Sw -editor
meillo@95: with an empty argument.
meillo@97: .Ci 75fca31a5b9d5c1a99c74ab14c94438d8852fba9
meillo@95: (Specifying
meillo@95: .Cl "-editor true
meillo@95: is nearly the same, only differing by the previous editor being set.)
meillo@95: .P
meillo@95: The more important change is the removal of the
meillo@95: .Sw -nowhatnowproc
meillo@95: switch.
meillo@97: .Ci ee4f43cf2ef0084ec698e4e87159a94c01940622
meillo@95: This switch had introduced an awkward behavior, as explained in nmh's
meillo@95: man page for
meillo@95: .Mp comp (1):
meillo@98: .QS
meillo@98: The \-editor editor switch indicates the editor to use for
meillo@98: the initial edit. Upon exiting from the editor, comp will
meillo@98: invoke the whatnow program. See whatnow(1) for a discussion
meillo@98: of available options. The invocation of this program can be
meillo@98: inhibited by using the \-nowhatnowproc switch. (In truth of
meillo@98: fact, it is the whatnow program which starts the initial
meillo@98: edit. Hence, \-nowhatnowproc will prevent any edit from
meillo@95: occurring.)
meillo@98: .QE
meillo@95: .P
meillo@95: Effectively, the
meillo@95: .Sw -nowhatnowproc
meillo@100: switch creates only a draft message.
meillo@95: As
meillo@95: .Cl "-whatnowproc true
meillo@95: causes the same behavior, the
meillo@95: .Sw -nowhatnowproc
meillo@95: switch was removed for being redundant.
meillo@100: Likely, the
meillo@95: .Sw -nowhatnowproc
meillo@100: switch was intended to be used by front-ends.
meillo@95: 
meillo@95: 
meillo@95: .U3 "Compatibility Switches
meillo@95: .BU
meillo@95: The hidden
meillo@95: .Sw -[no]total
meillo@95: switches of
meillo@95: .Pn flist .
meillo@95: They were simply the inverse of the visible
meillo@95: .Sw -[no]fast
meillo@95: switches:
meillo@95: .Sw -total
meillo@95: was
meillo@95: .Sw -nofast
meillo@95: and
meillo@95: .Sw -nototal
meillo@95: was
meillo@95: .Sw -fast .
meillo@95: I removed the
meillo@95: .Sw -[no]total
meillo@95: legacy.
meillo@97: .Ci ea21fe2c4bd23c639bef251398fae809875732ec
meillo@95: .BU
meillo@95: The
meillo@95: .Sw -subject
meillo@95: switch of
meillo@95: .Pn sortm
meillo@95: existed for compatibility only.
meillo@95: It can be fully replaced by
meillo@95: .Cl "-textfield subject
meillo@95: thus it was removed.
meillo@97: .Ci 00140a3c86e9def69d98ba2ffd4d6e50ef6326ea
meillo@95: 
meillo@95: 
meillo@95: .U3 "Various
meillo@95: .BU
meillo@96: In order to avoid prefix collisions among switch names, the
meillo@95: .Sw -version
meillo@95: switch was renamed to
meillo@95: .Sw -Version
meillo@95: (with capital `V').
meillo@97: .Ci 32b2354dbaf4bf934936eb5b102a4a3d2fdd209a
meillo@95: Every program has the
meillo@95: .Sw -version
meillo@95: switch but its first three letters collided with the
meillo@95: .Sw -verbose
meillo@95: switch, present in many programs.
meillo@95: The rename solved this problem once for all.
meillo@95: Although this rename breaks a basic interface, having the
meillo@95: .Sw -V
meillo@95: abbreviation to display the version information, isn't all too bad.
meillo@95: .BU
meillo@95: .Sw -[no]preserve
meillo@95: of
meillo@95: .Pn refile
meillo@95: was removed because what use was it anyway?
meillo@98: .QS
meillo@95: Normally when a message is refiled, for each destination
meillo@95: folder it is assigned the number which is one above the current
meillo@95: highest message number in that folder. Use of the
meillo@95: \-preserv [sic!] switch will override this message renaming, and try
meillo@95: to preserve the number of the message. If a conflict for a
meillo@95: particular folder occurs when using the \-preserve switch,
meillo@95: then refile will use the next available message number which
meillo@95: is above the message number you wish to preserve.
meillo@98: .QE
meillo@95: .BU
meillo@95: The removal of the
meillo@95: .Sw -[no]reverse
meillo@95: switches of
meillo@95: .Pn scan
meillo@97: .Ci 8edc5aaf86f9f77124664f6801bc6c6cdf258173
meillo@95: is a bug fix, supported by the comments
meillo@95: ``\-[no]reverse under #ifdef BERK (I really HATE this)''
meillo@95: by Rose and
meillo@95: ``Lists messages in reverse order with the `\-reverse' switch.
meillo@95: This should be considered a bug.'' by Romine in the documentation.
meillo@97: The question remains why neither Rose and Romine had fixed this
meillo@109: bug in the eighties when they wrote these comments nor has anyone
meillo@95: thereafter.
meillo@93: 
meillo@93: 
meillo@93: .ig
meillo@93: 
meillo@95: forw: [no]dashstuffing(mhl)
meillo@93: 
meillo@95: mhshow: [no]pause [no]serialonly
meillo@93: 
meillo@93: mhmail: resent queued
meillo@93: inc: snoop, (pop)
meillo@93: 
meillo@95: mhl: [no]faceproc folder sleep
meillo@95: 	[no]dashstuffing(forw) digest list volume number issue number
meillo@93: 
meillo@95: prompter: [no]doteof
meillo@93: 
meillo@93: refile: [no]preserve [no]unlink [no]rmmproc
meillo@93: 
meillo@95: send: [no]forward [no]mime [no]msgid
meillo@93: 	[no]push split [no]unique (sasl) width snoop [no]dashstuffing
meillo@93: 	attach attachformat
meillo@93: whatnow: (noedit) attach
meillo@93: 
meillo@93: slocal: [no]suppressdups
meillo@93: 
meillo@95: spost: [no]filter [no]backup width [no]push idanno
meillo@93: 	[no]check(whom) whom(whom)
meillo@93: 
meillo@93: whom: ???
meillo@93: 
meillo@95: ..
meillo@93: 
meillo@93: 
meillo@93: .ig
meillo@93: 
meillo@93: .P
meillo@93: In the best case, all switches are unambiguous on the first character,
meillo@93: or on the three-letter prefix for the `no' variants.
meillo@96: Reducing switch prefix collisions, shortens the necessary prefix length
meillo@93: the user must type.
meillo@93: Having less switches helps best.
meillo@93: 
meillo@93: ..
meillo@58: 
meillo@95: 
meillo@102: .\" XXX: whatnow prompt commands
meillo@102: 
meillo@102: 
meillo@95: 
meillo@95: 
meillo@74: .H1 "Modernizing
meillo@102: .P
meillo@109: The code base of mmh originates from the late seventies.
meillo@109: Through the eighties, extensive work had been done on it.
meillo@109: In the nineties, it was partly reorganized and extended.
meillo@102: Relicts from each decade have gathered in the code base.
meillo@102: My goal was to modernize the code base.
meillo@102: 
meillo@102: .P
meillo@102: FIXME functional aspect only here
meillo@102: .P
meillo@102: FIXME ref to `code style' for non-functional aspects.
meillo@58: 
meillo@58: 
meillo@100: .H2 "Code Relicts
meillo@0: .P
meillo@109: My position to drop obsolete functions of mmh, in order to remove old code,
meillo@104: is much more revolutional than the nmh community likes to have it.
meillo@104: Working on an experimental version, I was able to quickly drop
meillo@104: functionality I considered ancient.
meillo@104: The need for consensus with peers would have slowed this process down.
meillo@104: Without the need to justify my decisions, I was able to rush forward.
meillo@110: In December 2011, Paul Vixie motivated the nmh developers to just
meillo@104: do the work:
meillo@104: .[
meillo@104: paul vixie edginess nmh-workers
meillo@104: .]
meillo@104: .QS
meillo@104: let's stop walking on egg shells with this code base. there's no need to
meillo@104: discuss whether to keep using vfork, just note in [sic!] passing, [...]
meillo@104: we don't need a separate branch for removing vmh
meillo@104: or ridding ourselves of #ifdef's or removing posix replacement functions
meillo@104: or depending on pure ansi/posix "libc".
meillo@104: .QP
meillo@104: these things should each be a day or two of work and the "main branch"
meillo@104: should just be modern. [...]
meillo@104: let's push forward, aggressively.
meillo@104: .QE
meillo@104: .LP
meillo@104: I did so already in the months before.
meillo@104: I pushed forward.
meillo@104: I simply dropped the cruft.
meillo@104: .P
meillo@104: The decision to drop a feature was based on literature research and
meillo@104: careful thinking, but whether having had contact to this particular
meillo@104: feature within my own computer life served as a rule of thumb.
meillo@109: Always, I explained my reasons in the commit messages
meillo@109: in the version control system.
meillo@104: Hence, others can comprehend my view and argue for undoing the change
meillo@104: if I have missed an important aspect.
meillo@109: I was quick in dropping parts.
meillo@109: I rather re-included falsely dropped parts than going a slower pace.
meillo@109: Mmh is experimental work; it required tough decisions.
meillo@12: 
meillo@102: 
meillo@104: .U3 "Forking
meillo@12: .P
meillo@109: Being a tool chest, MH creates many processes.
meillo@104: In earlier times
meillo@104: .Fu fork()
meillo@104: had been an expensive system call, because the process's image needed
meillo@104: to be duplicated completely at once.
meillo@109: This was especially painful in the common case when the image gets
meillo@104: replaced by a call to
meillo@104: .Fu exec()
meillo@104: right after having forked the child process.
meillo@104: The
meillo@104: .Fu vfork()
meillo@104: system call was invented to speed up this particular case.
meillo@104: It completely omits the duplication of the image.
meillo@104: On old systems this resulted in significant speed ups.
meillo@104: Therefore MH used
meillo@104: .Fu vfork()
meillo@104: whenever possible.
meillo@12: .P
meillo@104: Modern memory management units support copy-on-write semantics, which make
meillo@104: .Fu fork()
meillo@104: almost as fast as
meillo@104: .Fu vfork() .
meillo@104: The man page of
meillo@104: .Mp vfork (2)
meillo@104: in FreeBSD 8.0 states:
meillo@104: .QS
meillo@104: This system call will be eliminated when proper system sharing mechanisms
meillo@104: are implemented. Users should not depend on the memory sharing semantics
meillo@104: of vfork() as it will, in that case, be made synonymous to fork(2).
meillo@104: .QE
meillo@104: .LP
meillo@104: Vixie supports the removal with the note that ``the last
meillo@104: system on which fork was so slow that an mh user would notice it, was
meillo@104: Eunice. that was 1987''.
meillo@104: .[
meillo@104: nmh-workers vixie edginess
meillo@104: .]
meillo@104: I replaced all calls to
meillo@104: .Fu vfork()
meillo@104: with calls to
meillo@104: .Fu fork() .
meillo@109: .Ci 40821f5c1316e9205a08375e7075909cc9968e7d
meillo@104: .P
meillo@104: Related to the costs of
meillo@104: .Fu fork()
meillo@104: is the probability of its success.
meillo@109: In the eighties, on heavy loaded systems, calls to
meillo@104: .Fu fork()
meillo@104: were prone to failure.
meillo@104: Hence, many of the
meillo@104: .Fu fork()
meillo@104: calls in the code were wrapped into loops to retry the
meillo@104: .Fu fork()
meillo@109: several times, to increase the changes to succeed, eventually.
meillo@109: On modern systems, a failing
meillo@104: .Fu fork()
meillo@109: call is unusual.
meillo@104: Hence, in the rare case when
meillo@104: .Fu fork()
meillo@104: fails, mmh programs simply abort.
meillo@109: .Ci 5fbf37ee68e018998ada61eeab73e035b26834b6
meillo@12: 
meillo@12: 
meillo@109: .U3 "Header Fields
meillo@104: .BU
meillo@84: The
meillo@84: .Hd Encrypted
meillo@104: header field was introduced by RFC\|822,
meillo@109: but already marked as legacy in RFC\|2822.
meillo@109: Today, OpenPGP provides the basis for standardized exchange of encrypted
meillo@104: messages [RFC\|4880, RFC\|3156].
meillo@109: Hence, the support for
meillo@104: .Hd Encrypted
meillo@104: header fields is removed in mmh.
meillo@109: .Ci 064527f7b57ab050e5af13e15ad99aeeab125857
meillo@104: .BU
meillo@84: Native support for
meillo@84: .Hd Face
meillo@104: header fields has been removed, as well.
meillo@109: .Ci 8e5be81f784682822f5e868c1bf3c8624682bd23
meillo@104: This feature is similar to the
meillo@84: .Hd X-Face
meillo@84: header field in its intent,
meillo@21: but takes a different approach to store the image.
meillo@84: Instead of encoding the image data directly into the header field,
meillo@109: it contains the hostname and UDP port where the image
meillo@109: date can be retrieved.
meillo@109: There exists even a third Face system,
meillo@109: which is the successor of
meillo@109: .Hd X-Face ,
meillo@109: although it re-uses the
meillo@104: .Hd Face
meillo@109: header field.
meillo@109: It was invented in 2005 and supports colored PNG images.
meillo@104: None of the Face systems described here is popular today.
meillo@104: Hence, mmh has no direct support for them.
meillo@104: .BU
meillo@104: The
meillo@104: .Hd Content-MD5
meillo@104: header field was introduced by RFC\|1864.
meillo@104: It provides detection of data corruption during the transfer.
meillo@104: But it can not ensure verbatim end-to-end delivery of the contents
meillo@104: [RFC\|1864].
meillo@104: The proper approach to verify content integrity in an
meillo@104: end-to-end relationship is the use of digital cryptography.
meillo@104: .\" XXX (RFCs FIXME).
meillo@104: On the other hand, transfer protocols should detect corruption during
meillo@109: the transmission.
meillo@109: The TCP includes a checksum field therefore.
meillo@104: These two approaches in combinations render the
meillo@104: .Hd Content-MD5
meillo@104: header field superfluous.
meillo@109: Not a single one out of 4\|200 messages from two decades
meillo@109: in an nmh-workers mailing list archive contains a
meillo@104: .Hd Content-MD5
meillo@104: header field.
meillo@104: Neither did any of the 60\|000 messages in my personal mail storage.
meillo@104: Removing the support for this header field,
meillo@104: removed the last place where MD5 computation was needed.
meillo@109: .Ci 31dc797eb5178970d68962ca8939da3fd9a8efda
meillo@104: Hence, the MD5 code could be removed as well.
meillo@104: Over 500 lines of code vanished by this one change.
meillo@104: 
meillo@104: 
meillo@104: .U3 "MMDF maildrop support
meillo@21: .P
meillo@104: This type of format is conceptionally similar to the mbox format,
meillo@104: but uses a different message delimiter (`\fL^A^A^A^A\fP' instead of
meillo@104: `\fLFrom\0\fP').
meillo@104: Mbox is the de-facto standard maildrop format on Unix,
meillo@109: whereas the MMDF maildrop format became forgotten.
meillo@104: I did drop MMDF maildrop format support.
meillo@109: Mbox is the only packed mailbox format supported in mmh.
meillo@104: .P
meillo@109: The simplifications within the code were moderate.
meillo@109: Mainly, the reading and writing of MMDF mailbox files was removed.
meillo@109: But also, switches of
meillo@109: .Pn packf
meillo@104: and
meillo@109: .Pn rcvpack
meillo@109: could be removed.
meillo@109: .Ci 3916ab66ad5d183705ac12357621ea8661afd3c0
meillo@109: In the message parsing function
meillo@109: .Fn sbr/m_getfld.c ,
meillo@109: knowledge of MMDF packed mail boxes was removed.
meillo@109: .Ci 684ec30d81e1223a282764452f4902ed4ad1c754
meillo@109: Further code structure simplifications may be possible there,
meillo@109: because only one single packed mailbox format is left to be supported.
meillo@104: I have not worked on them yet because
meillo@104: .Fu m_getfld()
meillo@104: is heavily optimized and thus dangerous to touch.
meillo@104: The risk of damaging the intricate workings of the optimized code is
meillo@104: too high.
meillo@104: .\" XXX: move somewhere else
meillo@104: This problem is know to the developers of nmh, too.
meillo@109: They also avoid touching this minefield.
meillo@104: 
meillo@12: 
meillo@101: .U3 "Prompter's Control Keys
meillo@20: .P
meillo@20: The program
meillo@20: .Pn prompter
meillo@104: queries the user to fill in a message form.
meillo@104: When used by
meillo@20: .Pn comp
meillo@104: as
meillo@104: .Cl "comp -editor prompter" ,
meillo@20: the resulting behavior is similar to
meillo@20: .Pn mailx .
meillo@51: Apparently,
meillo@20: .Pn prompter
meillo@104: hadn't been touched lately.
meillo@104: Otherwise it's hardly explainable why it
meillo@20: still offered the switches
meillo@84: .Sw -erase
meillo@84: .Ar chr
meillo@20: and
meillo@84: .Sw -kill
meillo@84: .Ar chr
meillo@20: to name the characters for command line editing.
meillo@21: The times when this had been necessary are long time gone.
meillo@20: Today these things work out-of-the-box, and if not, are configured
meillo@20: with the standard tool
meillo@20: .Pn stty .
meillo@104: The switches are removed now
meillo@104: .Ci 0bd9750710cdbab80cfb4036dd87af20afe1552f .
meillo@20: 
meillo@104: 
meillo@109: .U3 "Hardcopy Terminal Support
meillo@21: .P
meillo@109: More of a funny anecdote is a check for being connected to a
meillo@109: hardcopy terminal.
meillo@109: It remained in the code until Spring 2012, when I finally removed it
meillo@104: .Ci b7764c4a6b71d37918a97594d866258f154017ca .
meillo@109: I would be truly happy to see such a terminal in action today,
meillo@109: maybe even being able to work on it.
meillo@109: But I fear my chances are null.
meillo@21: .P
meillo@109: The check only prevented a pager to be placed between the printing
meillo@104: program (\c
meillo@104: .Pn mhl )
meillo@104: and the terminal.
meillo@109: In nmh, this could have been ensured statically with the
meillo@104: .Sw -nomoreproc
meillo@109: at the command line, too.
meillo@109: In mmh, seting the profile entry
meillo@104: .Pe Pager
meillo@104: or the environment variable
meillo@104: .Ev PAGER
meillo@104: to
meillo@109: .Pn cat
meillo@109: does the job.
meillo@104: 
meillo@104: 
meillo@21: 
meillo@12: 
meillo@58: .H2 "Attachments
meillo@22: .P
meillo@101: The mind model of email attachments is unrelated to MIME.
meillo@101: Although the MIME RFCs (2045 through 2049) define the technical
meillo@109: requirements for having attachments, they do not mention the word
meillo@101: ``attachment''.
meillo@101: Instead of attachments, MIME talks about ``multi-part message bodies''
meillo@101: [RFC\|2045], a more general concept.
meillo@101: Multi-part messages are messages
meillo@101: ``in which one or more different
meillo@101: sets of data are combined in a single body''
meillo@101: [RFC\|2046].
meillo@101: MIME keeps its descriptions generic;
meillo@101: it does not imply specific usage models.
meillo@109: One usage model became prevalent: attachments.
meillo@101: The idea is having a main text document with files of arbitrary kind
meillo@101: attached to it.
meillo@101: In MIME terms, this is a multi-part message having a text part first
meillo@110: and parts of arbitrary type following.
meillo@101: .P
meillo@101: MH's MIME support is a direct implementation of the RFCs.
meillo@101: The perception of the topic described in the RFCs is clearly visible
meillo@101: in MH's implementation.
meillo@109: In result, MH had all the MIME features but no idea of attachments.
meillo@109: But users don't need all the MIME features,
meillo@109: they want convenient attachment handling.
meillo@109: 
meillo@102: 
meillo@102: .U3 "Composing MIME Messages
meillo@102: .P
meillo@102: In order to improve the situation on the message composing side,
meillo@102: Jon Steinhart had added an attachment system to nmh in 2002.
meillo@101: .Ci 7480dbc14bc90f2d872d434205c0784704213252
meillo@102: In the file
meillo@102: .Fn docs/README-ATTACHMENTS ,
meillo@102: he described his motivation to do so as such:
meillo@101: .QS
meillo@101: Although nmh contains the necessary functionality for MIME message handing,
meillo@101: the interface to this functionality is pretty obtuse.
meillo@101: There's no way that I'm ever going to convince my partner to write
meillo@101: .Pn mhbuild
meillo@101: composition files!
meillo@101: .QE
meillo@102: .LP
meillo@102: With this change, the mind model of attachments entered nmh.
meillo@102: In the same document:
meillo@101: .QS
meillo@101: These changes simplify the task of managing attachments on draft files.
meillo@101: They allow attachments to be added, listed, and deleted.
meillo@101: MIME messages are automatically created when drafts with attachments
meillo@101: are sent.
meillo@101: .QE
meillo@102: .LP
meillo@102: Unfortunately, the attachment system,
meillo@102: like any new facilities in nmh,
meillo@110: was inactive by default.
meillo@101: .P
meillo@101: During my work in Argentina, I tried to improve the attachment system.
meillo@102: But, because of great opposition in the nmh community,
meillo@102: my patch died as a proposal on the mailing list, after long discussions.
meillo@101: .[
meillo@101: nmh-workers attachment proposal
meillo@101: .]
meillo@110: In January 2012, I extended the patch and applied it to mmh.
meillo@101: .Ci 8ff284ff9167eff8f5349481529332d59ed913b1
meillo@102: In mmh, the attachment system is active by default.
meillo@102: Instead of command line switches, the
meillo@102: .Pe Attachment-Header
meillo@102: profile entry is used to specify
meillo@102: the name of the attachment header field.
meillo@102: It is pre-defined to
meillo@102: .Hd Attach .
meillo@101: .P
meillo@101: To add an attachment to a draft, simply add an attachment header:
meillo@101: .VS
meillo@101: To: bob
meillo@101: Subject: The file you wanted
meillo@101: Attach: /path/to/the/file-bob-wanted
meillo@101: --------
meillo@101: Here it is.
meillo@101: VE
meillo@101: The header field can be added to the draft manually in the editor,
meillo@102: or by using the `attach' command at the WhatNow prompt, or
meillo@102: non-interactively with
meillo@101: .Pn anno :
meillo@101: .VS
meillo@102: anno -append -nodate -component Attach -text /path/to/attachment
meillo@101: VE
meillo@102: Drafts with attachment headers are converted to MIME automatically by
meillo@102: .Pn send .
meillo@102: The conversion to MIME is invisible to the user.
meillo@102: The draft stored in the draft folder is always in source form, with
meillo@101: attachment headers.
meillo@101: If the MIMEification fails, for instance because the file to attach
meillo@101: is not accessible, the original draft is not changed.
meillo@101: .P
meillo@102: The attachment system handles the forwarding of messages, too.
meillo@101: If the attachment header value starts with a plus character (`+'),
meillo@101: like in
meillo@101: .Cl "Attach: +bob 30 42" ,
meillo@101: The given messages in the specified folder will be attached.
meillo@101: This allowed to simplify
meillo@101: .Pn forw .
meillo@101: .Ci f41f04cf4ceca7355232cf7413e59afafccc9550
meillo@101: .P
meillo@101: Closely related to attachments is non-ASCII text content,
meillo@101: because it requires MIME too.
meillo@102: In nmh, the user needed to call `mime' at the WhatNow prompt
meillo@101: to have the draft converted to MIME.
meillo@102: This was necessary whenever the draft contained non-ASCII characters.
meillo@101: If the user did not call `mime', a broken message would be sent.
meillo@101: Therefore, the
meillo@101: .Pe automimeproc
meillo@101: profile entry could be specified to have the `mime' command invoked
meillo@102: automatically each time.
meillo@101: Unfortunately, this approach conflicted with with attachment system
meillo@101: because the draft would already be in MIME format at the time
meillo@101: when the attachment system wanted to MIMEify it.
meillo@102: To use nmh's attachment system, `mime' must not be called at the
meillo@102: WhatNow prompt and
meillo@101: .Pe automimeproc
meillo@102: must not be set in the profile.
meillo@101: But then the case of non-ASCII text without attachment headers was
meillo@101: not caught.
meillo@102: All in all, the solution was complex and irritating.
meillo@102: My patch from December 2010 would have simplified the situation.
meillo@102: .P
meillo@101: Mmh's current solution is even more elaborate.
meillo@101: Any necessary MIMEification is done automatically.
meillo@101: There is no `mime' command at the WhatNow prompt anymore.
meillo@102: The draft will be converted automatically to MIME when either an
meillo@102: attachment header or non-ASCII text is present.
meillo@101: Further more, the special meaning of the hash character (`#')
meillo@102: at line beginnings in the draft message is removed.
meillo@102: Users need not at all deal with the whole topic.
meillo@101: .P
meillo@102: Although the new approach does not anymore support arbitrary MIME
meillo@102: compositions directly, the full power of
meillo@101: .Pn mhbuild
meillo@101: can still be accessed.
meillo@102: Given no attachment headers are included, the user can create
meillo@101: .Pn mhbuild
meillo@102: composition drafts like in nmh.
meillo@101: Then, at the WhatNow prompt, he needs to invoke
meillo@101: .Cl "edit mhbuild
meillo@101: to convert it to MIME.
meillo@110: Because the resulting draft does neither contain non-ASCII characters
meillo@102: nor has it attachment headers, the attachment system will not touch it.
meillo@101: .P
meillo@101: The approach taken in mmh is taylored towards todays most common case:
meillo@101: a text part with possibly attachments.
meillo@102: This case is simplified a lot for users.
meillo@102: 
meillo@112: 
meillo@102: .U3 "MIME Type Guessing
meillo@102: .P
meillo@102: The use of
meillo@101: .Pn mhbuild
meillo@102: composition drafts had one notable advantage over attachment headers
meillo@102: from the programmer's point of view: The user provides the appropriate
meillo@102: MIME types for files to include.
meillo@102: The attachment system needs to find out the correct MIME type itself.
meillo@102: This is a difficult task, yet it spares the user irritating work.
meillo@102: Determining the correct MIME type of content is partly mechanical,
meillo@102: partly intelligent work.
meillo@102: Forcing the user to find out the correct MIME type,
meillo@102: forces him to do partly mechanical work.
meillo@102: Letting the computer do the work, can lead to bad choices for difficult
meillo@102: content.
meillo@102: For mmh, the latter option was chosen.
meillo@102: .P
meillo@102: Determining the MIME type by the suffix of the file name is a dumb
meillo@102: approach, yet it is simple to implement and provides good results
meillo@102: for the common cases.
meillo@102: Mmh implements this approach in the
meillo@102: .Pn print-mimetype
meillo@102: script.
meillo@112: .Ci 4b5944268ea0da7bb30598a27857304758ea9b44
meillo@102: Using it is the default choice.
meillo@102: .P
meillo@112: A far better, though less portable, approach is the use of
meillo@102: .Pn file .
meillo@102: This standard tool tries to determine the type of files.
meillo@102: Unfortunately, its capabilities and accuracy varies from system to system.
meillo@102: Additionally, its output was only intended for human beings,
meillo@102: but not to be used by programs.
meillo@102: It varies much.
meillo@102: Nevertheless, modern versions of GNU
meillo@102: .Pn file ,
meillo@102: which is prevalent on the popular GNU/Linux systems,
meillo@102: provides MIME type output in machine-readable form.
meillo@102: Although this solution is highly system-dependent,
meillo@102: it solves the difficult problem well.
meillo@102: On systems where GNU
meillo@102: .Pn file ,
meillo@102: version 5.04 or higher, is available it should be used.
meillo@102: One needs to specify the following profile entry to do so:
meillo@112: .Ci 3baec236a39c5c89a9bda8dbd988d643a21decc6
meillo@102: .VS
meillo@102: Mime-Type-Query: file -b --mime
meillo@102: VE
meillo@102: .LP
meillo@102: Other versions of
meillo@102: .Pn file
meillo@102: might possibly be usable with wrapper scripts to reformat the output.
meillo@102: The diversity among
meillo@102: .Pn file
meillo@102: implementations is great; one needs to check the local variant.
meillo@102: .P
meillo@102: If no MIME type can be determined, text content gets sent as
meillo@102: `text/plain' and anything else under the generic fall-back type
meillo@102: `application/octet-stream'.
meillo@102: It is not possible in mmh to override the automatic MIME type guessing
meillo@102: for a specific file.
meillo@102: To do so, the user would need to know in advance for which file
meillo@102: the automatic guessing does fail, or the system would require interaction.
meillo@102: I consider both cases impractical.
meillo@102: The existing solution should be sufficient.
meillo@102: If not, the user may always fall back to
meillo@102: .Pn mhbuild
meillo@102: composition drafts and ignore the attachment system.
meillo@101: 
meillo@102: 
meillo@102: .U3 "Storing Attachments
meillo@102: .P
meillo@108: Extracting MIME parts of a message and storing them to disk is done by
meillo@108: .Pn mhstore .
meillo@108: The program has two operation modes,
meillo@108: .Sw -auto
meillo@108: and
meillo@108: .Sw -noauto .
meillo@108: With the former one, each part is stored under the filename given in the
meillo@108: MIME part's meta information, if available.
meillo@108: This naming information is usually available for modern attachments.
meillo@108: If no filename is available, this MIME part is stored as if
meillo@108: .Sw -noauto
meillo@108: would have been specified.
meillo@108: In the
meillo@108: .Sw -noauto
meillo@108: mode, the parts are processed according to rules, defined by
meillo@108: .Pe mhstore-store-*
meillo@108: profile entries.
meillo@108: These rules define generic filename templates for storing
meillo@108: or commands to post-process the contents in arbitrary ways.
meillo@108: If no matching rule is available the part is stored under a generic
meillo@108: filename, built from message number, MIME part number, and MIME type.
meillo@108: .P
meillo@108: The
meillo@108: .Sw -noauto
meillo@108: mode had been the default in nmh because it was considered safe,
meillo@108: in contrast to the
meillo@108: .Sw -auto
meillo@108: mode.
meillo@108: In mmh,
meillo@108: .Sw -auto
meillo@108: is not dangerous anymore.
meillo@108: Two changes were necessary:
meillo@108: .BU
meillo@108: Any directory path is removed from the proposed filename.
meillo@108: Thus, the files are always stored in the expected directory.
meillo@108: .Ci 41b6eadbcecf63c9a66aa5e582011987494abefb
meillo@108: .BU
meillo@108: Tar files are not extracted automatically any more.
meillo@108: Thus, the rest of the file system will not be touched.
meillo@108: .Ci 94c80042eae3383c812d9552089953f9846b1bb6
meillo@108: .LP
meillo@108: Now, the outcome of mmh's
meillo@108: .Cl "mhstore -auto
meillo@110: can be foreseen from the output of
meillo@108: .Cl "mhlist -verbose" .
meillo@108: .P
meillo@108: The
meillo@108: .Sw -noauto
meillo@108: mode is seen to be more powerful but less convenient.
meillo@108: On the other hand,
meillo@108: .Sw -auto
meillo@108: is safe now and
meillo@108: storing attachments under their original name is intuitive.
meillo@108: Hence,
meillo@108: .Sw -auto
meillo@108: serves better as the default option.
meillo@108: .Ci 3410b680416c49a7617491af38bc1929855a331d
meillo@108: .P
meillo@108: Files are stored into the directory given by the
meillo@108: .Pe Nmh-Storage
meillo@108: profile entry, if set, or
meillo@108: into the current working directory, otherwise.
meillo@108: Storing to different directories is only possible with
meillo@108: .Pe mhstore-store-*
meillo@108: profile entries.
meillo@108: .P
meillo@108: Still, in both modes, existing files get overwritten silently.
meillo@108: This can be considered a bug.
meillo@108: Yet, each other behavior has its draw-backs, too.
meillo@108: Refusing to replace files requires adding a
meillo@108: .Sw -force
meillo@108: option.
meillo@108: Users will likely need to invoke
meillo@108: .Pn mhstore
meillo@108: a second time with
meillo@108: .Sw -force
meillo@108: then.
meillo@108: Eventually, only the user can decide in the concrete case.
meillo@108: This requires interaction, which I like to avoid if possible.
meillo@108: Appending a unique suffix to the filename is another bad option.
meillo@108: For now, the behavior remains as it is.
meillo@108: .P
meillo@108: In mmh, only MIME parts of type message are special in
meillo@108: .Pn mhstore 's
meillo@108: .Sw -auto
meillo@108: mode.
meillo@108: Instead of storing message/rfc822 parts as files to disk,
meillo@108: they are stored as messages into the current mail folder.
meillo@108: The same applies to message/partial, only, the parts are reassembled
meillo@108: automatically before.
meillo@108: Parts of type message/external-body are not automatically retrieved
meillo@108: anymore. Instead, Information on how to retrieve them is output.
meillo@108: Not supporting this rare case saved nearly one thousand lines of code.
meillo@108: .Ci 55e1d8c654ee0f7c45b9361ce34617983b454c32
meillo@108: .\" XXX mention somewhere else too: (The profile entry `nmh-access-ftp'
meillo@108: .\"     and sbr/ruserpass.c for reading ~/.netrc are gone now.)
meillo@108: Not special anymore is `application/octet-stream; type=tar'.
meillo@108: Automatically extracting such MIME parts had been the dangerous part
meillo@108: of the
meillo@108: .Sw -auto
meillo@108: mode.
meillo@108: .Ci 94c80042eae3383c812d9552089953f9846b1bb6
meillo@108: 
meillo@102: 
meillo@102: 
meillo@102: .U3 "Showing MIME Messages
meillo@102: .P
meillo@114: The program
meillo@114: .Pn mhshow
meillo@114: had been written to display MIME messages.
meillo@114: It implemented the conceptional view of the MIME RFCs.
meillo@114: Nmh's
meillo@114: .Pn mhshow
meillo@114: handled each MIME part independently, presenting them separately
meillo@114: to the user.
meillo@114: This does not match today's understanding of email attachments,
meillo@114: where displaying a message is seen to be a single, integrated operation.
meillo@114: Today, email messages are expected to consist of a main text part
meillo@114: plus possibly attachments.
meillo@114: They are not any more seen to be arbitrary MIME hierarchies with
meillo@114: information on how to display the individual parts.
meillo@114: I adjusted
meillo@114: .Pn mhshow 's
meillo@114: behavior to the modern view on the topic.
meillo@114: .P
meillo@114: Note that this section completely ignores the original
meillo@114: .Pn show
meillo@114: program, because it was not capable to display MIME messages
meillo@114: and is no longer part of mmh.
meillo@114: Although
meillo@114: .Pn mhshow
meillo@114: was renamed to
meillo@114: .Pn show
meillo@114: in mmh, this section uses the name
meillo@114: .Pn mhshow ,
meillo@114: in order to avoid confusion.
meillo@114: .P
meillo@114: In mmh, the basic idea is that
meillo@114: .Pn mhshow
meillo@114: should display a message in one single pager session.
meillo@114: Therefore,
meillo@114: .Pn mhshow
meillo@114: invokes a pager session for all its output,
meillo@114: whenever it prints to a terminal.
meillo@114: .Ci a4197ea6ffc5c1550e8b52d5a654bcaaaee04a4e
meillo@114: In consequence,
meillo@114: .Pn mhl
meillo@114: does no more invoke a pager.
meillo@114: .Ci 0e46503be3c855bddaeae3843e1b659279c35d70
meillo@114: With
meillo@114: .Pn mhshow
meillo@114: replacing the original
meillo@114: .Pn show ,
meillo@114: output from
meillo@114: .Pn mhl
meillo@114: does not go to the terminal directly, but through
meillo@114: .Pn mhshow .
meillo@114: Hence,
meillo@114: .Pn mhl
meillo@114: does not need to invoke a pager.
meillo@114: The one and only job of
meillo@114: .Pn mhl
meillo@114: is to format messages or parts of them.
meillo@114: The only place in mmh, where a pager is invoked is
meillo@114: .Pn mhshow .
meillo@114: .P
meillo@114: .Pe mhshow-show-*
meillo@114: profile entries can be used to display MIME parts in a specific way.
meillo@114: For instance, PDF and Postscript files could be converted to plain text
meillo@114: to display them in the terminal.
meillo@114: In mmh, the displaying of MIME parts will always be done serially.
meillo@114: The request to display the MIME type `multipart/parallel' in parallel
meillo@114: is ignored.
meillo@114: It is simply treated as `multipart/mixed'.
meillo@114: .Ci d0581ba306a7299113a346f9b4c46ce97bc4cef6
meillo@114: This could already be requested with the, now removed,
meillo@114: .Sw -serialonly
meillo@114: switch of
meillo@114: .Pn mhshow .
meillo@114: As MIME parts are always processed exclusively , i.e. serially,
meillo@114: the `%e' escape in
meillo@114: .Pe mhshow-show-*
meillo@114: profile entries became useless and was thus removed.
meillo@114: .Ci a20d405db09b7ccca74d3e8c57550883da49e1ae
meillo@114: .P
meillo@114: In the intended setup, only text content would be displayed.
meillo@114: Non-text content would be converted to text by appropriate
meillo@114: .Pe mhshow-show-*
meillo@114: profile entries before, if possible and wanted.
meillo@114: All output would be displayed in a single pager session.
meillo@114: Other kinds of attachments are ignored.
meillo@114: With
meillo@114: .Pe mhshow-show-*
meillo@114: profile entries for them, they can be displayed serially along
meillo@114: the message.
meillo@114: For parallel display, the attachments need to be stored to disk first.
meillo@114: .P
meillo@114: To display text content in foreign charsets, they need to be converted
meillo@114: to the native charset.
meillo@114: Therefore,
meillo@114: .Pe mhshow-charset-*
meillo@114: profile entries used to be needed.
meillo@114: In mmh, the convertion is done automatically by piping the text through
meillo@114: the
meillo@114: .Pn iconv
meillo@114: command, if necessary.
meillo@114: .Ci 2433122c20baccb10b70b49c04c6b0497b5b3b60
meillo@114: Custom
meillo@114: .Pe mhshow-show-*
meillo@114: rules for textual content might need a
meillo@114: .Cl "iconv -f %c %f |
meillo@114: prefix to have the text converted to the native charset.
meillo@114: .P
meillo@114: Although the convertion of foreign charsets to the native one
meillo@114: has improved, it is not consistent enough.
meillo@114: Further work needs to be done and
meillo@114: the basic concepts in this field need to be re-thought.
meillo@114: Though, the default setup of mmh displays message in foreign charsets
meillo@114: correctly without the need to configure anything.
meillo@114: 
meillo@114: 
meillo@114: .ig
meillo@114: 
meillo@114: .P
meillo@114: mhshow/mhstore: Removed support for retrieving message/external-body parts.
meillo@114: These tools won't download the contents automatically anymore. Instead,
meillo@114: they print the information needed to get the contents. If someone should
meillo@114: really receive one of those rare message/external-body messages, he can
meillo@114: do the job manually. We save nearly a thousand lines of code. That's worth
meillo@114: it!
meillo@114: (The profile entry `nmh-access-ftp' and sbr/ruserpass.c for reading
meillo@114: ~/.netrc are gone now.)
meillo@114: .Ci 55e1d8c654ee0f7c45b9361ce34617983b454c32
meillo@114: 
meillo@114: ..
meillo@102: 
meillo@58: 
meillo@58: 
meillo@58: .H2 "Digital Cryptography
meillo@22: .P
meillo@58: Signing and encryption.
meillo@112: .P
meillo@112: FIXME
meillo@58: 
meillo@58: 
meillo@102: 
meillo@102: .H2 "Modern Defaults
meillo@22: .P
meillo@116: Nmh has a bunch of convenience-improving features inactive by default,
meillo@116: although one can expect every new user wanting to have them active.
meillo@112: The reason they are inactive by default is the wish to stay compatible
meillo@112: with old versions.
meillo@116: But what is the definition for old versions.
meillo@116: Still, the highly useful draft folder facility is not active by default
meillo@116: although it had been introduced over twenty-five years ago
meillo@112: .[
meillo@112: rose romine real work
meillo@112: .]
meillo@116: \(en the community seems not to care.
meillo@116: This is one of several examples that require new users to build up
meillo@116: their profile before they can access the modern features of nmh.
meillo@116: Without an extensively built-up profile, the setup is hardly usable
meillo@116: for modern emailing.
meillo@116: The point is not the customization of the setup,
meillo@116: but the activating of generally useful facilities.
meillo@112: .P
meillo@116: Yet, the real problem lies less in enabling the features, as this is
meillo@116: straight forward as soon as one knows what he wants.
meillo@116: The real problem is that new users need deep insights into the project
meillo@116: before they find out what they are missing and that nmh actually
meillo@116: provides it already, it just was not activated.
meillo@116: To give an example, I needed one year of using nmh
meillo@102: before I became aware of the existence of the attachment system.
meillo@102: One could argue that this fact disqualifies my reading of the
meillo@102: documentation.
meillo@102: If I would have installed nmh from source back then, I could agree.
meillo@116: Yet, I had used a prepackaged version and had expected that it would
meillo@102: just work.
meillo@116: Nevertheless, I had been conviced by the concepts of MH already
meillo@116: and I am a software developer,
meillo@116: still I required a lot of time to discover the cool features.
meillo@116: How can we expect users to be even more advanced than me,
meillo@116: just to allow them use MH in a convenient and modern way?
meillo@116: Unless they are strongly convinced of the concepts, they will fail.
meillo@116: I have seen friends of me giving up disappointed
meillo@116: before they truly used the system,
meillo@116: although they had been motivated in the beginning.
meillo@116: They suffer hard enough to get used to the toolchest approach,
meillo@116: we should spare them further inconveniences.
meillo@116: .P
meillo@116: Maintaining compatibility for its own sake is for no good.
meillo@116: If any MH implementation would be the back-end of widespread
meillo@116: email clients with large user bases, compatibility would be more
meillo@116: important.
meillo@116: Yet, it appears as if this is not the case.
meillo@116: Hence, compatibility is hardly important for technical reasons.
meillo@116: Its importance originates rather from personal reasons.
meillo@116: Nmh's user base is small and old.
meillo@116: Changing the interfaces would cause inconvenience to long-term users of MH.
meillo@116: It would force them to change their many years old MH configurations.
meillo@116: I do understand this aspect, but it keeps new users from using MH.
meillo@116: By sticking to the old users, new users are kept away.
meillo@116: Yet, the future lies in new users.
meillo@116: Hence, mmh invites new users by providing a convenient and modern setup,
meillo@116: readily usable out-of-the-box.
meillo@116: .P
meillo@116: In mmh, all modern features are active by default.
meillo@116: In consequence, a setup with a profile that defines only the path to the
meillo@116: mail storage, is already convenient to use.
meillo@116: Again, Paul Vixie's ``edginess'' appeal supports the direction I took:
meillo@116: ``the `main branch' should just be modern''.
meillo@116: .[
meillo@116: paul vixie edginess nmh-workers
meillo@116: .]
meillo@116: .P
meillo@116: Modern features that are active in mmh by default include: 
meillo@116: .BU
meillo@116: The attachment system (\c
meillo@116: .Hd Attach ).
meillo@116: .Ci 8ff284ff9167eff8f5349481529332d59ed913b1
meillo@116: .BU
meillo@116: The draft folder facility (\c
meillo@116: .Fn +drafts ).
meillo@116: .Ci 337338b404931f06f0db2119c9e145e8ca5a9860
meillo@116: .BU
meillo@116: The unseen sequence (`u')
meillo@116: .Ci c2360569e1d8d3678e294eb7c1354cb8bf7501c1
meillo@116: and the sequence negation prefix (`!').
meillo@116: .Ci db74c2bd004b2dc9bf8086a6d8bf773ac051f3cc
meillo@116: .BU
meillo@116: Quoting the original message in the reply.
meillo@116: .Ci 67411b1f95d6ec987b4c732459e1ba8a8ac192c6
meillo@116: .BU
meillo@116: Forwarding messages using MIME.
meillo@116: .Ci 6e271608b7b9c23771523f88d23a4d3593010cf1
meillo@116: 
meillo@58: 
meillo@58: 
meillo@58: 
meillo@100: .H1 "Code Style
meillo@22: .P
meillo@58: foo
meillo@58: 
meillo@58: 
meillo@58: .H2 "Standard Code
meillo@22: .P
meillo@58: POSIX
meillo@22: 
meillo@102: .U3 "Converting to Standard Code
meillo@102: .P
meillo@102: One part of this task was converting obsolete code constructs
meillo@102: to standard constructs.
meillo@102: As I'm not even thirty years old and have no more than seven years of
meillo@102: Unix experience, I needed to learn about the history in retrospective.
meillo@102: Older people likely have used those ancient constructs themselves
meillo@102: and have suffered from their incompatibilities and have longed for
meillo@102: standardization.
meillo@102: Unfortunately, I have only read that others had done so.
meillo@102: This put me in a much more difficult positions when working on the old
meillo@102: code.
meillo@102: I needed to recherche what other would have known by heart from
meillo@102: experience.
meillo@102: All my programming experience comes from a time past ANSI C
meillo@102: and past POSIX.
meillo@102: Although I knew about the times before, I took the
meillo@102: current state implicitly for granted most of the time.
meillo@102: .P
meillo@102: Being aware of
meillo@102: these facts, I rather let people with more historic experience solve the 
meillo@102: task of converting the ancient code constructs to standardized ones.
meillo@102: Luckily, Lyndon Nerenberg focused on this task at the nmh project.
meillo@102: He converted large parts of the code to POSIX constructs, removing
meillo@102: the conditionals compilation for now standardized features.
meillo@104: I'm thankful for this task being solved.
meillo@104: I only pulled the changes into
meillo@102: mmh.
meillo@102: 
meillo@102: 
meillo@102: 
meillo@22: 
meillo@58: .H2 "Separation
meillo@14: 
meillo@58: .U2 "MH Directory Split
meillo@0: .P
meillo@19: In MH and nmh, a personal setup had consisted of two parts:
meillo@19: The MH profile, named
meillo@19: .Fn \&.mh_profile
meillo@19: and being located directly in the user's home directory.
meillo@19: And the MH directory, where all his mail messages and also his personal
meillo@104: forms, scan formats, other configuration files are stored.
meillo@104: The location
meillo@104: of this directory could be user-chosen.
meillo@104: The default was to name it
meillo@19: .Fn Mail
meillo@19: and have it directly in the home directory.
meillo@19: .P
meillo@19: I've never liked the data storage and the configuration to be intermixed.
meillo@104: They are different kinds of data.
meillo@104: One part, are the messages,
meillo@104: which are the data to operate on.
meillo@104: The other part, are the personal
meillo@19: configuration files, which are able to change the behavior of the operations.
meillo@19: The actual operations are defined in the profile, however.
meillo@19: .P
meillo@19: When storing data, one should try to group data by its type.
meillo@19: There's sense in the Unix file system hierarchy, where configuration
meillo@19: file are stored separate (\c
meillo@19: .Fn /etc )
meillo@19: to the programs (\c
meillo@19: .Fn /bin
meillo@19: and
meillo@19: .Fn /usr/bin )
meillo@19: to their sources (\c
meillo@19: .Fn /usr/src ).
meillo@19: Such separation eases the backup management, for instance.
meillo@19: .P
meillo@19: In mmh, I've reorganized the file locations.
meillo@19: Still there are two places:
meillo@19: There's the mail storage directory, which, like in MH, contains all the
meillo@19: messages, but, unlike in MH, nothing else.
meillo@19: Its location still is user-chosen, with the default name
meillo@19: .Fn Mail ,
meillo@104: in the user's home directory.
meillo@104: This is much similar to the case in nmh.
meillo@19: The configuration files, however, are grouped together in the new directory
meillo@19: .Fn \&.mmh
meillo@19: in the user's home directory.
meillo@19: The user's profile now is a file, named
meillo@19: .Fn profile ,
meillo@19: in this mmh directory.
meillo@19: Consistently, the context file and all the personal forms, scan formats,
meillo@19: and the like, are also there.
meillo@19: .P
meillo@19: The naming changed with the relocation.
meillo@19: The directory where everything, except the profile, had been stored (\c
meillo@19: .Fn $HOME/Mail ),
meillo@104: used to be called \fIMH directory\fP.
meillo@104: Now, this directory is called the
meillo@104: user's \fImail storage\fP.
meillo@104: The name \fImmh directory\fP is now given to
meillo@19: the new directory
meillo@19: (\c
meillo@19: .Fn $HOME/.mmh ),
meillo@19: containing all the personal configuration files.
meillo@19: .P
meillo@19: The separation of the files by type of content is logical and convenient.
meillo@19: There are no functional differences as any possible setup known to me
meillo@19: can be implemented with both approaches, although likely a bit easier
meillo@104: with the new approach.
meillo@104: The main goal of the change had been to provide
meillo@19: sensible storage locations for any type of personal mmh file.
meillo@19: .P
meillo@19: In order for one user to have multiple MH setups, he can use the
meillo@19: environment variable
meillo@19: .Ev MH
meillo@19: the point to a different profile file.
meillo@19: The MH directory (mail storage plus personal configuration files) is
meillo@19: defined by the
meillo@19: .Pe Path
meillo@19: profile entry.
meillo@19: The context file could be defined by the
meillo@19: .Pe context
meillo@19: profile entry or by the
meillo@19: .Ev MHCONTEXT
meillo@19: environment variable.
meillo@19: The latter is useful to have a distinct context (e.g. current folders)
meillo@19: in each terminal window, for instance.
meillo@19: In mmh, there are three environment variables now.
meillo@19: .Ev MMH
meillo@19: may be used to change the location of the mmh directory.
meillo@19: .Ev MMHP
meillo@19: and
meillo@19: .Ev MMHC
meillo@19: change the profile and context files, respectively.
meillo@19: Besides providing a more consistent feel (which simply is the result
meillo@19: of being designed anew), the set of personal configuration files can
meillo@19: be chosen independently from the profile (including mail storage location)
meillo@104: and context, now.
meillo@104: Being it relevant for practical use or not, it
meillo@104: de-facto is an improvement.
meillo@104: However, the main achievement is the
meillo@19: split between mail storage and personal configuration files.
meillo@17: 
meillo@0: 
meillo@58: .H2 "Modularization
meillo@0: .P
meillo@58: whatnowproc
meillo@0: .P
meillo@49: The \fIMH library\fP
meillo@49: .Fn libmh.a
meillo@49: collects a bunch of standard functions that many of the MH tools need,
meillo@49: like reading the profile or context files.
meillo@49: This doesn't hurt the separation.
meillo@49: 
meillo@58: 
meillo@58: .H2 "Style
meillo@58: .P
meillo@58: Code layout, goto, ...
meillo@58: 
meillo@102: .P
meillo@102: anno rework
meillo@102: 
meillo@58: 
meillo@58: 
meillo@58: 
meillo@89: .H1 "Concept Exploitation/Homogeneity
meillo@58: 
meillo@58: 
meillo@58: .H2 "Draft Folder
meillo@58: .P
meillo@58: Historically, MH provided exactly one draft message, named
meillo@58: .Fn draft
meillo@58: and
meillo@104: being located in the MH directory.
meillo@104: When starting to compose another message
meillo@58: before the former one was sent, the user had been questioned whether to use,
meillo@104: refile or replace the old draft.
meillo@104: Working on multiple drafts at the same time
meillo@104: was impossible.
meillo@104: One could only work on them in alteration by refiling the
meillo@104: previous one to some directory and fetching some other one for reediting.
meillo@58: This manual draft management needed to be done each time the user wanted
meillo@58: to switch between editing one draft to editing another.
meillo@58: .P
meillo@58: To allow true parallel editing of drafts, in a straight forward way, the
meillo@104: draft folder facility exists.
meillo@104: It had been introduced already in July 1984
meillo@104: by Marshall T. Rose.
meillo@110: The facility was inactive by default.
meillo@110: Even in nmh, the draft folder facility remained inactive by default.
meillo@58: At least, Richard Coleman added the man page
meillo@58: .Mp mh-draft(5)
meillo@58: to document
meillo@58: the feature well.
meillo@58: .P
meillo@58: The only advantage of not using the draft folder facility is the static
meillo@104: name of the draft file.
meillo@104: This could be an issue for MH front-ends like mh-e.
meillo@58: But as they likely want to provide working on multiple drafts in parallel,
meillo@104: the issue is only concerning compatibility.
meillo@104: The aim of nmh to stay compatible
meillo@58: prevented the default activation of the draft folder facility.
meillo@58: .P
meillo@58: On the other hand, a draft folder is the much more natural concept than
meillo@104: a draft message.
meillo@104: MH's mail storage consists of folders and messages,
meillo@104: the messages named with ascending numbers.
meillo@104: A draft message breaks with this
meillo@58: concept by introducing a message in a file named
meillo@58: .Fn draft .
meillo@58: This draft
meillo@104: message is special.
meillo@104: It can not be simply listed with the available tools,
meillo@104: but instead requires special switches.
meillo@104: I.e. corner-cases were
meillo@104: introduced.
meillo@104: A draft folder, in contrast, does not introduce such
meillo@104: corner-cases.
meillo@104: The available tools can operate on the messages within that
meillo@104: folder like on any messages within any mail folders.
meillo@104: The only difference
meillo@58: is the fact that the default folder for
meillo@58: .Pn send
meillo@58: is the draft folder,
meillo@58: instead of the current folder, like for all other tools.
meillo@58: .P
meillo@58: The trivial part of the change was activating the draft folder facility
meillo@104: by default and setting a default name for this folder.
meillo@104: Obviously, I chose
meillo@58: the name
meillo@58: .Fn +drafts .
meillo@58: This made the
meillo@82: .Sw -draftfolder
meillo@58: and
meillo@82: .Sw -draftmessage
meillo@58: switches useless, and I could remove them.
meillo@58: The more difficult but also the part that showed the real improvement,
meillo@58: was updating the tools to the new concept.
meillo@82: .Sw -draft
meillo@58: switches could
meillo@58: be dropped, as operating on a draft message became indistinguishable to
meillo@58: operating on any other message for the tools.
meillo@58: .Pn comp
meillo@58: still has its
meillo@82: .Sw -use
meillo@58: switch for switching between its two modes: (1) Compose a new
meillo@104: draft, possibly by taking some existing message as a form.
meillo@104: (2) Modify
meillo@104: an existing draft.
meillo@104: In either case, the behavior of
meillo@58: .Pn comp is
meillo@104: deterministic.
meillo@104: There is no more need to query the user.
meillo@104: I consider this
meillo@104: a major improvement.
meillo@104: By making
meillo@58: .Pn send
meillo@58: simply operate on the current
meillo@58: message in the draft folder by default, with message and folder both
meillo@58: overridable by specifying them on the command line, it is now possible
meillo@58: to send a draft anywhere within the storage by simply specifying its folder
meillo@58: and name.
meillo@58: .P
meillo@58: All theses changes converted special cases to regular cases, thus
meillo@58: simplifying the tools and increasing the flexibility.
meillo@58: 
meillo@58: 
meillo@58: .H2 "Trash Folder
meillo@58: .P
meillo@58: Similar to the situation for drafts is the situation for removed messages.
meillo@104: Historically, a message was deleted by renaming.
meillo@104: A specific
meillo@58: \fIbackup prefix\fP, often comma (\c
meillo@58: .Fn , )
meillo@58: or hash (\c
meillo@58: .Fn # ),
meillo@104: being prepended to the file name.
meillo@104: Thus, MH wouldn't recognize the file
meillo@58: as a message anymore, as only files whose name consists of digits only
meillo@104: are treated as messages.
meillo@104: The removed messages remained as files in the
meillo@58: same directory and needed some maintenance job to truly delete them after
meillo@104: some grace time.
meillo@104: Usually, by running a command similar to
meillo@82: .VS
meillo@82: find /home/user/Mail -ctime +7 -name ',*' | xargs rm
meillo@82: VE
meillo@104: in a cron job.
meillo@104: Within the grace time interval
meillo@58: the original message could be restored by stripping the
meillo@104: the backup prefix from the file name.
meillo@104: If however, the last message of
meillo@58: a folder is been removed \(en say message
meillo@58: .Fn 6
meillo@58: becomes file
meillo@58: .Fn ,6
meillo@58: \(en and a new message enters the same folder, thus the same
meillo@58: numbered being given again \(en in our case
meillo@58: .Fn 6
meillo@58: \(en, if that one
meillo@58: is removed too, then the backup of the former message gets overwritten.
meillo@58: Thus, the ability to restore removed messages does not only depend on
meillo@58: the ``sweeping cron job'' but also on the removing of further messages.
meillo@58: This is undesirable, because the real mechanism is hidden from the user
meillo@58: and the consequences of further removals are not always obvious.
meillo@58: Further more, the backup files are scattered within the whole mail
meillo@58: storage, instead of being collected at one place.
meillo@58: .P
meillo@58: To improve the situation, the profile entry
meillo@58: .Pe rmmproc
meillo@58: (previously named
meillo@58: .Pe Delete-Prog )
meillo@58: was introduced, very early.
meillo@58: It could be set to any command, which would care for the mail removal
meillo@58: instead of taking the default action, described above.
meillo@58: Refiling the to-be-removed files to some garbage folder was a common
meillo@104: example.
meillo@104: Nmh's man page
meillo@58: .Mp rmm(1)
meillo@58: proposes
meillo@58: .Cl "refile +d
meillo@58: to move messages to the garbage folder and
meillo@58: .Cl "rm `mhpath +d all`
meillo@58: the empty the garbage folder.
meillo@104: Managing the message removal this way is a sane approach.
meillo@104: It keeps
meillo@58: the removed messages in one place, makes it easy to remove the backup
meillo@58: files, and, most important, enables the user to use the tools of MH
meillo@104: itself to operate on the removed messages.
meillo@104: One can
meillo@58: .Pn scan
meillo@58: them,
meillo@58: .Pn show
meillo@58: them, and restore them with
meillo@58: .Pn refile .
meillo@58: There's no more
meillo@58: need to use
meillo@58: .Pn mhpath
meillo@58: to switch over from MH tools to Unix tools \(en MH can do it all itself.
meillo@58: .P
meillo@58: This approach matches perfect with the concepts of MH, thus making
meillo@104: it powerful.
meillo@104: Hence, I made it the default.
meillo@104: And even more, I also
meillo@58: removed the old backup prefix approach, as it is clearly less powerful.
meillo@58: Keeping unused alternative in the code is a bad choice as they likely
meillo@104: gather bugs, by not being constantly tested.
meillo@104: Also, the increased code
meillo@104: size and more conditions crease the maintenance costs.
meillo@104: By strictly
meillo@58: converting to the trash folder approach, I simplified the code base.
meillo@58: .Pn rmm
meillo@58: calls
meillo@58: .Pn refile
meillo@58: internally to move the to-be-removed
meillo@58: message to the trash folder (\c
meillo@58: .Fn +trash
meillo@104: by default).
meillo@104: Messages
meillo@58: there can be operated on like on any other message in the storage.
meillo@58: The sweep clean, one can use
meillo@82: .Cl "rmm -unlink +trash a" ,
meillo@58: where the
meillo@82: .Sw -unlink
meillo@58: switch causes the files to be truly unliked instead
meillo@58: of moved to the trash folder.
meillo@58: 
meillo@58: 
meillo@58: .H2 "Path Notations
meillo@58: .P
meillo@58: foo
meillo@58: 
meillo@58: 
meillo@58: .H2 "MIME Integration
meillo@58: .P
meillo@58: user-visible access to whole messages and MIME parts are inherently
meillo@58: different
meillo@58: 
meillo@58: 
meillo@58: .H2 "Of One Cast
meillo@58: .P