-TODO for 1.1 And Beyond
+TODO for 1.2 And Beyond
=======================
-lib/silccrypt
-=============
+NOTE: Any item that doesn't have (***DONE) in it, isn't done yet. The
+(***TESTING NEEDED) means that the item has been done but not yet properly
+tested.
- o Implement the defined SilcDH API. The definition is in
- lib/silccrypt/silcdh.h.
+NOTE: A TODO entry does not mean that it is ever going to be done. Some
+of the entries may be just ideas, good, bad or ugly. If you want to work
+on some of the TODO entries simply let us know about it by dropping a note
+to silc-devel mailing list or appear on 'silc' channel on SILCNet.
- o SSH2 public keys support, allowing the use of SSH2 public keys in
- SILC.
- o OpenPGP certificate support, allowing the use of PGP public keys
- in SILC.
+General
+=======
- o SILC PKCS (silcpkcs.h) reorganizing when other PK supports added.
- Move the SILC Public Key routines away from the crypto library into
- the core library (silccore). silc_pkcs_public/private_key_* routines
- to silc_public/private_key_* routines. The silc_public_key_* routines
- should also automatically handle SILC Public Keys, and other keys
- and certificates as well. Add fe. silcpk.h into silccore. It should
- also include the Public Key Payload encoding and decoding routines.
+ o Create apps/tutorial containing various Toolkit API tutorials.
- o Add DSS support.
+ o The Toolkit split. The Toolkit is to be splitted in parts. How many
+ parts and what the parts are isn't decided yet. Each part is a separate
+ software package. Current thinking is of the following:
- o Cipher optimizations (asm, that this) at least for i386 would be nice.
+ SILC Toolkit SILC protocol, client and server library
+ SILC Runtime Toolkit runtime library
+ SILC Crypto Toolkit crypto, asn1, math, skr, pgp, etc.
- o ECDSA and ECDH.
+ The rationale for this is of course that other than SILC projects
+ might like to use the various libraries SILC Toolkit provides, but
+ naturally they don't want the bloat of SILC protocol related stuff.
+ The Runtime library in SILC Toolkit is a general purpose runtime library,
+ like Glib and APR are. The runtime library is to be developed further
+ to provide alternative to Glib and APR.
-lib/silccore/silcpacket.[ch] ****PARTLY DONE****
-============================
+ The Crypto library in SILC Toolkit is a general purpose crypto library
+ providing pretty nice APIs compared to many other crypto libraries,
+ especially OpenSSL. The Crypto library is to be developed further
+ to include support for OpenPGP, X.509 and SSH2.
- o SilcPacketEngine.
- o New SILC Packet API.
+lib/silccore
+============
+ o SILC_PACKET_FLAG_ACK support. Implement ACK packet and packet payload
+ to silcpacket.c.
-lib/silccore/silcid.[ch]
-========================
+ o All payload encoding routines should take SilcStack as argument.
- o Add silc_id_str2id to accept the destination buffer as argument
- and thus not require any memory allocation. Same will happen
- with silc_id_payload_* functions.
+ o All payload test routines into lib/silccore/tests/.
- o silc_id_str2id, silc_id2str to non-allocating routines.
+lib/silcclient, The Client Library
+==================================
-lib/silcutil
-============
+ o peer-to-peer private messages
- o Compression routines are missing. The protocol supports packet
- compression thus it must be implemented. SILC Zip API must be
- defined.
+ o Private message key request notification to application. See XXX in
+ client_prvmsg.c.
+
+ o in JOIN notify handle resolving that timedout. Currently the user is
+ never joined the channel if this happens. What to do if message is
+ received from user that hasn't been resolved/joined?
+
+ o Message ACKing support.
+
+ o in /cmode and /cumode with +r, maybe the public key and private key
+ could be just some "string", which would then match to "string.pub" and
+ "string.prv".
+
+
+Runtime library, lib/silcutil/
+==============================
+
+ o Fix universal time decoding (doesn't accept all formats) in silctime.c.
+
+ o Add functions to manipulate environment variables.
+
+ SilcBool silc_setenv(const char *variable, const char *value);
+ const char *silc_getenv(const char *variable);
+ SilcBool silc_clearenv(const char *variable);
+
+ o Add functions to loading shared/dynamic object symbols (replaces the
+ SIM library (lib/silcsim) and introduces generic library).
+
+ SilcDll silc_dll_load(const char *object_path, SilcDllFlags flags);
+ void silc_dll_close(SilcDll dll);
+ void *silc_dll_getsym(SilcDll dll, const char *symbol);
+ const char *silc_dll_error(SilcDll dll);
+
+ o Add directory opening/traversing functions
+
+ o silc_getopt routines
+
+ o silc_hash_table_replace -> silc_hash_table_set. Retain support for
+ silc_hash_table_replace as macro.
+
+ o The SILC Event signals. Asynchronous events that can be created,
+ connected to and signalled. Either own event routines or glued into
+ SilcSchedule:
+
+ SilcTask silc_schedule_task_add_event(SilcSchedule schedule,
+ const char *event, ...);
+ SilcBool silc_schedule_event_connect(SilcSchedule schedule,
+ const char *event,
+ SilcTaskCallback event_callback,
+ void *context);
+ SilcBool silc_schedule_event_signal(SilcSchedule schedule,
+ const char *event, ...);
+
+ Example:
+ silc_schedule_task_add_event(schedule, "connected",
+ SILC_PARAM_UI32_INT,
+ SILC_PARAM_BUFFER,
+ SILC_PARAM_END);
+ silc_schedule_event_connect(schedule, "connected", connected_cb, ctx);
+ silc_schedule_event_signal(schedule, "connected", integer, buf,
+ SILC_PARAM_END);
+ SILC_TASK_CALLBACK(connected_cb)
+ {
+ FooCtx ctx = context;
+ va_list args;
+ SilcUInt32 integer;
+ SilcBuffer buf;
+
+ va_start(args, context);
+ integer = va_arg(args, SilcUInt32);
+ buf = va_arg(args, SilcBuffer);
+ va_end(args);
+ ...
+ }
+
+ Problems: Events would be SilcSchedule specific, and would not work on
+ multi-thread/multi-scheduler system. The events should be copyable
+ between schedulers.
+
+ o Structured log messages to Log API. Allows machine readable log
+ messages. Would allow sending of any kind of data in a log message.
+
+ o Base64 to an own API
+
+ o Timer API
o Add builtin SOCKS and HTTP Proxy support, well the SOCKS at least.
SILC currently supports SOCKS4 and SOCKS5 but it needs to be compiled
in separately.
- o bool -> SilcBool
+ o silc_stringprep to non-allocating version.
- o SilcBit, bit field:
+ o SilcStack aware SilcHashTable.
- #define SilcBit(b) unsigned int b : 1
+ o SilcStack aware SilcDList.
+ o Compression routines are missing. The protocol supports packet
+ compression thus it must be implemented. SILC Zip API must be
+ defined.
-lib/silcutil/silcbuffer.h ****DONE****
-=========================
+ (o Generic SilcStatus or SilcResult that includes all possible status and
+ error conditions, including those of SILC protocol. Though, the SILC
+ protocol related status (currently in silcstatus.h) cannot be in
+ runtime library) maybe
- o Remove the `truelen' field from SilcBuffer as it is entirely
- redundant since we can get the true length of the buffer by
- doing buffer->end - buffer->header. Add silc_buffer_truelen
- macro instead. Consider also removing `len' field too since
- it effectively is buffer->tail - buffer->data, and adding
- silc_buffer_len macro can do the same. These would save
- totally 8 bytes of memory per buffer.
+ (o Thread pool) maybe
+ (o SILC specific socket creation/closing routines to silcnet.h, wrappers
+ to all send(), recv(), sendto() etc. Bad thing is that we'd have to
+ define all socket options, sockaddrs, etc.) maybe
-lib/silcutil/silcbuffmt.[ch] ****PARTY DONE****
-============================
+ (o mmap) maybe
- o SILC_STR_APPEND, _APPEND_TAIL.
- o SILC_STR_OFFSET
+lib/silcutil/symbian/
+=====================
+ o Something needs to be thought to the logging globals as well,
+ like silc_debug etc. They won't work on EPOC. Perhaps logging
+ and debugging is to be disabled on EPOC. The logging currently works
+ by it cannot be controlled, same with debugging.
-lib/silcutil/silcstack.[ch] ****DONE****
+
+SFTP Library, lib/silcsftp/
===========================
- o Data stack implementation
+ o Read prefetch (read-ahead, reading ahead of time). Maybe if this can
+ be done easily.
+
+SKR Library, lib/silcskr/
+=========================
-lib/silcutil/silcstream.[ch] ****DONE****
-============================
+ o Add fingerprint as search constraint.
+
+ o Add OpenPGP support. Adding, removing, fetching PGP keys. (Keyring
+ support?)
+
+ o Add support for importing public keys from a directory and/or from a
+ file. Add support for exporting the repository (different formats for
+ different key types?).
+
+ o Change the entire silc_skr_find API. Remove SilcSKRFind and just simply
+ add the find constraints as variable argument list to silc_skr_find, eg:
+
+ silc_skr_find(skr, schedule, callback, context,
+ SILC_SKR_FIND_PUBLIC_KEY, public_key,
+ SILC_SKR_FIND_COUNTRY, "FI",
+ SILC_SKR_FIND_USAGE, SILC_SKR_USAGE_AUTH,
+ SILC_SKR_FIND_END);
+
+ NULL argument would be ignored and skipped.
+
+ o Add OR logical rule in addition of the current default AND, eg:
+
+ // Found key(s) MUST have this public key AND this country.
+ silc_skr_find(skr, schedule, callback, context,
+ SILC_SKR_FIND_RULE_AND,
+ SILC_SKR_FIND_PUBLIC_KEY, public_key,
+ SILC_SKR_FIND_COUNTRY, "FI",
+ SILC_SKR_FIND_END);
+
+ // Found key(s) MUST have this public key OR this key context
+ silc_skr_find(skr, schedule, callback, context,
+ SILC_SKR_FIND_RULE_OR,
+ SILC_SKR_FIND_PUBLIC_KEY, public_key,
+ SILC_SKR_FIND_CONTEXT, key_context,
+ SILC_SKR_FIND_END);
+
+
+Crypto Library, lib/silccrypt/
+==============================
+
+ o Add fingerprint to SilcSILCPublicKey and retrieval to silcpk.h, and
+ possibly to silcpkcs.h.
+
+ /* Return fingerprint of the `public_key'. Returns also the algorithm
+ that has been used to make the fingerprint. */
+ const unsigned char *
+ silc_pkcs_get_fingerprint(SilcPublicKey public_key,
+ const char **hash_algorithm,
+ SilcUInt32 *fingerprint_len);
+
+ o Change SILC PKCS API to asynchronous, so that accelerators can be used.
+ All PKCS routines should now take callbacks as argument and they should
+ be delivered to SilcPKCSObject and SilcPKCSAlgorithm too.
+
+ /* Signature computation callback */
+ typedef void (*SilcPKCSSignCb)(SilcBool success,
+ const unsigned char *signature,
+ SilcUInt32 signature_len,
+ void *context);
+
+ /* Signature verification callback */
+ typedef void (*SilcPKCSVerifyCb)(SilcBool success, void *context);
+
+ /* Encryption callback */
+ typedef void (*SilcPKCSEncryptCb)(SilcBool success,
+ const unsigned char *encrypted,
+ SilcUInt32 encrypted_len,
+ void *context);
+
+ /* Decryption callback */
+ typedef void (*SilcPKCSDecryptCb)(SilcBool success,
+ const unsigned char *decrypted,
+ SilcUInt32 decrypted_len,
+ void *context);
+
+ Either add new _async functions or add the callbacks to existing API
+ and if the callback is NULL then the API is not async and if provided
+ it may be async. For example;
+
+ SilcBool silc_pkcs_sign(SilcPrivateKey private_key,
+ unsigned char *src, SilcUInt32 src_len,
+ unsigned char *dst, SilcUInt32 dst_size,
+ SilcUInt32 *dst_len,
+ SilcBool compute_hash, SilcHash hash,
+ SilcPKCSSignCb async_sign,
+ void *async_sign_context);
+
+ (if this is done then there's no reason why the buffers in the
+ callbacks cannot be the ones user gives here) or allow only async:
+
+ SilcBool silc_pkcs_sign(SilcPrivateKey private_key,
+ unsigned char *src, SilcUInt32 src_len,
+ SilcBool compute_hash, SilcHash hash,
+ SilcPKCSSignCb async_sign,
+ void *async_sign_context);
+
+ or add new:
+
+ SilcBool silc_pkcs_sign_async(SilcPrivateKey private_key,
+ unsigned char *src, SilcUInt32 src_len,
+ SilcBool compute_hash, SilcHash hash,
+ SilcPKCSSignCb async_sign,
+ void *async_sign_context);
+
+ o Change PKCS Algorithm API to take SilcPKCSAlgorithm as argument to
+ encrypt, decrypt, sign and verify functions. We may need to for exmaple
+ check the alg->hash, supported hash functions. Maybe deliver it also
+ to all other functions in SilcPKCSAlgorithm to be consistent.
+
+ o Add DSS support. Take implementation from Tom or make it yourself.
- o Add abstract SilcStream.
+ o Implement the defined SilcDH API. The definition is in
+ lib/silccrypt/silcdh.h.
+ o All cipher, hash, hmac etc. allocation routines should take their name
+ in as const char * not const unsigned char *.
-lib/silcutil/silcsocketstream.[ch] ****PARTY DONE****
-==================================
+ o ECDSA and ECDH
- o Add SilcSocketStream.
+SILC Accelerator Library
+========================
-lib/silcutil/epoc/*
-===================
+ o SILC Accelerator API. Provides generic way to use different kind of
+ accelerators. Basically implements SILC PKCS API so that SilcPublicKey
+ and SilcPrivateKey can be used but they call the accelerators.
- o lib/silcutil/epoc routines missing or not completed.
+ Something in the lines of (preliminary):
- o The PKCS#1 also calls global RNG (even though it is not used
- currently in SILC, the interface allows its use).
+ /* Register accelerator to system */
+ SilcBool silc_acc_register(const SilcAccelerator acc);
- o Something needs to be thought to the logging globals as well,
- like silc_debug etc. They won't work on EPOC. Perhaps logging
- and debugging is to be disabled on EPOC.
+ /* Unregister accelerator */
+ SilcBool silc_acc_unregister(const SilcAccelerator acc);
+ /* Find existing accelerator. `name' is accelerators name and
+ `params' is optional accelerator specific parameters. */
+ SilcAccelerator silc_acc_find(const char *name, const char *params);
-lib/silcutil/silcschedule*.[ch] ****DONE****
-===============================
+ /* Return accelerator's displayable name */
+ const char *silc_ac_get_display_name(SilcAccelerator acc);
- o Scheduler can be optimized for FD tasks by changing the fd_queue
- to SilcHashTable instead of using linked list. We need to do
- one-to-one mapping of FD to task and hash table is more efficient
- for this usage.
+ /* Accelerate `public_key'. Return accelerated public key. */
+ SilcPublicKey silc_acc_public_key(SilcAccelerator acc,
+ SilcPublicKey public_key);
- Also redefine the silc_select to perhaps return a separate
- structure of the events that actually occurred, instead of
- returning the events in the fd_list which is then traversed
- in the generic code to find the changed events. This can be
- made faster by having own struct which includes only the
- changed events, thus the tarversing is faster since the whole
- fd_list is not traversed anymore (it is still traversed in the
- silc_select but at least it removes one extra tarversing later
- for the same list).
+ /* Accelerate `private_key'. Returns accelerated private key. */
+ SilcPrivateKey silc_acc_private_key(SilcAccelerator acc,
+ SilcPrivateKey private_key);
- Other task queues should be changed to use SilcList.
+ /* Return the underlaying public key */
+ SilcPublicKey silc_acc_get_public_key(SilcAccelerator acc,
+ SilcPublicKey public_key);
- o Add SILC scheduler's internal routines into a table of implementation
- function pointers, that the generic code then takes as extern from
- implementation. These are the silc_schedule_internal_* routines.
+ /* Return the underlaying private key */
+ SilcPrivateKey silc_acc_get_private_key(SilcAccelerator acc,
+ SilcPrivateKey private_key);
- o Change SILC_TASK_CALLBACK to non-static, and remove the macro
- SILC_TASK_CALLBACK_GLOBAL.
+ typedef struct SilcAcceleratorObject {
+ const char *name; /* Accelerator's name */
+ const char *display_name; /* Displayable name */
+ SilcAcceleratorType type; /* Accelerator type */
+ union {
+ struct {
+ SilcPKCSObject *pkcs; /* PKCS, may be NULL */
+ SilcPKCSAlgorithm *algorithm; /* Accelerator */
+ } pkcs;
+ struct {
-lib/silcutil/silcasync.[ch] ****DONE****
-===========================
+ } cipher;
+ } u;
+ } *SilcAccelerator, SilcAcceleratorStruct;
- o Add SilcAsyncOperation to utility library. Any function that takes
- callback as an argument must/should return SilcAsyncOperation.
+ SilcPublicKey->SilcSILCPublicKey->RsaPublicKey accelerated as:
+ SilcPublicKey->SilcSILCPublicKey->SilcAcceleratorSoftware->RsaPublicKey or
+ SilcPublicKey->SilcSILCPublicKey->SilcAcceleratorPublicKey->
+ SilcAcceleratorSoftware->RsaPublicKey
+ The former one if u.pkcs.pkcs == NULL.
-lib/silcutil/silctime.[ch] ****DONE****
-===========================
+ o Implement software accelerator. It is a thread pool system where the
+ public key and private key operations are executed in threads.
- o SilcTime.
+ This implements SilcPKCSAlgorithm (and SilcPKCSObject if needed) that
+ implements the thread acclerated system.
- o system time, universal, generalized.
+ (o Symmetric key cryptosystem acceleration? They are always sycnhronouos
+ even with hardware acceleration so the crypto API shouldn't require
+ changes.) maybe
lib/silcmath
============
+ o Import TFM. Talk to Tom to add the missing functions. Use TFM in
+ client and client library, but TMA in server, due to the significantly
+ increased memory consumption with TFM, and the rare need for public
+ key operations in server.
+
+ We want TFM's speed but not TFM's memory requirements. Talk to Tom
+ about making the TFM mp dynamic just as it is in LTM.
+
o The SILC MP API function must start returning indication of success
and failure of the operation.
o All utility functions should be made non-allocating ones.
-lib/silcasn1 ****PARTLY DONE****
-============
+SILC XML Library, lib/silcxml/
+==============================
- o ASN.1 library
+ o SILC XML API (wrapper to expat). The SILC XML API should follow and
+ resemble Simple API for XML (SAX).
- o Header documentation missing.
- o Some string encodings missing (copy/paste matter).
+lib/silcske/silcske.[ch]
+========================
+ o Ratelimit to UDP/IP transport for incoming packets.
-lib/silcpkix
+
+lib/silcasn1
============
- o PKIX implementation
+ o Negative integer encoding is missing, add it.
+ o SILC_ASN1_CHOICE should perhaps return an index what choice in the
+ choice list was found. Currently it is left for caller to figure out
+ which choice was found.
-lib/silcutil/silcfsm.[ch] ****DONE****
-=========================
+ o SILC_ASN1_NULL in decoding should return SilcBool whether or not
+ the NULL was present. It's important when it's SILC_ASN1_OPTIONAL
+ and we need to know whether it was present or not.
- o SILC Finite State Machine API. Replaces SILC Protocol API,
+lib/silcpgp
+===========
-lib/silcutil/silcnet*, lib/silcutil/*/silc*net* ****PARTLY DONE****
-===============================================
+ o OpenPGP certificate support, allowing the use of PGP public keys
+ in SILC.
- o Add UDP interface
- o New network interfaces
+lib/silcssh
+===========
- o Other functions should remain as they are since these new functions have
- to use them. This way we also provide them for applications that want
- to handle the sockets by themself.
+ o SSH2 public key/private key support, allowing the use of SSH2 keys
+ in SILC. RFC 4716.
-apps/silcd
-==========
+lib/silcpkix
+============
+
+ o PKIX implementation
+
- o Remove the big switch statement from the function
- silc_server_packet_parse_type and replace it with predefined
- table of function pointers where each of the slot in table
- represents the packet type value.
+lib/silcserver
+==============
- Same could be done with notify packets which has big switch
- statement too. Same kind of table of notify callbacks could be
- done as well.
+ o (Re)write commands/command replys.
- o The parser callback in the server will add a timeout task for
- all packets. It will require registering and allocating a
- new task to the SilcSchedule. Maybe, at least, for server
- and router packets the parser would be called immediately
- instead of adding it to the scheduler with 0 timeout. It
- should be analyzed too how slow the task registering process
- actually is, and find out ways to optimize it.
+ o (Re)write notify handling.
o The SERVER_SIGNOFF notify handing is not optimal, because it'll
cause sending of multiple SIGNOFF notify's instead of the one
done per channel. It shouldn't receive the whole list just
because one client happened to be on same channel.
- o MAYBE: The SilcChannelClientEntry can be:
- SilcUInt32 address;
- SilcUInt32 mode;
-
- where address is SilcClientEntry address XOR SilcChannelEntry.
- You can get SilcClientEntry by doing client = chl->address XOR channel,
- and SilcChannelEntry by doing channel = chl->address XOR client.
- As long as the other pointer is always available when accessing the
- structure this can be done.
-
o Add reference counters to all Silc*Entry structures
o SERVICEs support (plugin, SIM)
seconds. Now it is possible to accept n incoming JOIN commands
and process them without any timeouts. THis must be employed because
each JOIN command will create and distribute the new channel key
- to everybody on the channel (Fix this to 0.9.x).
+ to everybody on the channel.
+
+ o Related to above. If multiple JOINs are received in sequence perhaps
+ new key should be created only once, if the JOINs are handeled at the same
+ time. Now we create multiple keys and never end up using them because
+ many JOINs are processed at the same time in sequence. Only the last
+ key ends up being used.
o The CMODE cipher & hmac change problem (#101).